2019-01-15 13:25:08 [DEBUG   ] Finished updating ant stats in 1.999 seconds
2019-01-15 13:25:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:25:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:25:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:25:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:25:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:25:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:25:26 [DEBUG   ] Finished updating board flags in 1.997 seconds
2019-01-15 13:25:27 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2019-01-15 13:25:47 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 13:26:05 [DEBUG   ] Got command RPT from MCS: ref #1176238
2019-01-15 13:26:05 [DEBUG   ] summary = ERROR
2019-01-15 13:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176238  13 58498 48365017 A  ERRORERROR'
2019-01-15 13:26:05 [DEBUG   ] Got command RPT from MCS: ref #1176239
2019-01-15 13:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176239  77 58498 48365018 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:26:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 13:26:20 [DEBUG   ] Got command RPT from MCS: ref #1176257
2019-01-15 13:26:20 [DEBUG   ] summary = ERROR
2019-01-15 13:26:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176257  13 58498 48380257 A  ERRORERROR'
2019-01-15 13:26:20 [DEBUG   ] Got command RPT from MCS: ref #1176258
2019-01-15 13:26:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:26:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176258  77 58498 48380449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:26:20 [DEBUG   ] Got command RPT from MCS: ref #1176259
2019-01-15 13:26:20 [DEBUG   ] summary = ERROR
2019-01-15 13:26:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176259  13 58498 48380653 A  ERRORERROR'
2019-01-15 13:26:20 [DEBUG   ] Got command RPT from MCS: ref #1176261
2019-01-15 13:26:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:26:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176261  77 58498 48380857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:26:21 [DEBUG   ] Got command RPT from MCS: ref #1176262
2019-01-15 13:26:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 13:26:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176262  12 58498 48381061 A  ERRORB—™š'
2019-01-15 13:26:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:26:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:26:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:26:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:26:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:26:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:26:26 [DEBUG   ] Finished updating board flags in 1.797 seconds
2019-01-15 13:26:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 13:26:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 13:27:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 13:27:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:27:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 13:27:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:27:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:27:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:27:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:27:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:27:26 [DEBUG   ] Finished updating board flags in 1.556 seconds
2019-01-15 13:27:27 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-01-15 13:27:48 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 13:28:08 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 13:28:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:28:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 13:28:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:28:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:28:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:28:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:28:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:28:26 [DEBUG   ] Finished updating board flags in 1.404 seconds
2019-01-15 13:28:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 13:28:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 13:29:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 13:29:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:29:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:29:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:29:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:29:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:29:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:29:26 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-01-15 13:29:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 13:29:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 13:30:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 13:30:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:30:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:30:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:30:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:30:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:30:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:30:26 [DEBUG   ] Finished updating board flags in 1.382 seconds
2019-01-15 13:30:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 13:30:48 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 13:31:05 [DEBUG   ] Got command RPT from MCS: ref #1176275
2019-01-15 13:31:05 [DEBUG   ] summary = ERROR
2019-01-15 13:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176275  13 58498 48665017 A  ERRORERROR'
2019-01-15 13:31:05 [DEBUG   ] Got command RPT from MCS: ref #1176276
2019-01-15 13:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176276  77 58498 48665018 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:31:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 13:31:20 [DEBUG   ] Got command RPT from MCS: ref #1176292
2019-01-15 13:31:20 [DEBUG   ] summary = ERROR
2019-01-15 13:31:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176292  13 58498 48680329 A  ERRORERROR'
2019-01-15 13:31:20 [DEBUG   ] Got command RPT from MCS: ref #1176293
2019-01-15 13:31:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:31:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176293  77 58498 48680533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:31:20 [DEBUG   ] Got command RPT from MCS: ref #1176294
2019-01-15 13:31:20 [DEBUG   ] summary = ERROR
2019-01-15 13:31:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176294  13 58498 48680737 A  ERRORERROR'
2019-01-15 13:31:20 [DEBUG   ] Got command RPT from MCS: ref #1176295
2019-01-15 13:31:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:31:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176295  77 58498 48680941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:31:21 [DEBUG   ] Got command RPT from MCS: ref #1176296
2019-01-15 13:31:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 13:31:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176296  12 58498 48681133 A  ERRORB–™š'
2019-01-15 13:31:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:31:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 13:31:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:31:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:31:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:31:26 [WARNING ] (13, 1, 'bot')
2019-01-15 13:31:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:31:26 [DEBUG   ] Finished updating board flags in 1.501 seconds
2019-01-15 13:31:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 13:31:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 13:32:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 13:32:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:32:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:32:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:32:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:32:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:32:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:32:27 [DEBUG   ] Finished updating board flags in 2.185 seconds
2019-01-15 13:32:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 13:32:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 13:33:08 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 13:33:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:33:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:33:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:33:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:33:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:33:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:33:27 [DEBUG   ] Finished updating board flags in 1.904 seconds
2019-01-15 13:33:29 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 13:33:49 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 13:34:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 13:34:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:34:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 13:34:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:34:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:34:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:34:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:34:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:34:27 [DEBUG   ] Finished updating board flags in 1.823 seconds
2019-01-15 13:34:29 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 13:34:49 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-01-15 13:35:09 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 13:35:11 [DEBUG   ] Got command TBW from MCS: ref #1176302
2019-01-15 13:35:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-01-15 13:35:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1176302   8 58498 48911409 A  ERROR'
2019-01-15 13:35:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-01-15 13:35:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-01-15 13:35:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-01-15 13:35:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-01-15 13:35:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-01-15 13:35:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-01-15 13:35:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-01-15 13:35:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-01-15 13:35:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-01-15 13:35:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-01-15 13:35:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-01-15 13:35:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-01-15 13:35:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-01-15 13:35:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-01-15 13:35:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-01-15 13:35:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-01-15 13:35:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-01-15 13:35:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-01-15 13:35:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-01-15 13:35:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-01-15 13:35:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-01-15 13:35:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-01-15 13:35:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-01-15 13:35:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-01-15 13:35:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-01-15 13:35:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-01-15 13:35:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-01-15 13:35:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-01-15 13:35:14 [DEBUG   ] spawn_process: at 2019-01-15 13:35:14 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-01-15 13:35:14 [INFO    ] Finished spawning TBW
2019-01-15 13:35:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:35:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:35:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:35:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:35:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:35:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:35:27 [DEBUG   ] Finished updating board flags in 1.600 seconds
2019-01-15 13:36:05 [DEBUG   ] Got command RPT from MCS: ref #1176309
2019-01-15 13:36:05 [DEBUG   ] summary = ERROR
2019-01-15 13:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176309  13 58498 48965021 A  ERRORERROR'
2019-01-15 13:36:05 [DEBUG   ] Got command RPT from MCS: ref #1176310
2019-01-15 13:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176310  77 58498 48965022 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:36:20 [DEBUG   ] Got command RPT from MCS: ref #1176329
2019-01-15 13:36:20 [DEBUG   ] summary = ERROR
2019-01-15 13:36:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176329  13 58498 48980417 A  ERRORERROR'
2019-01-15 13:36:20 [DEBUG   ] Got command RPT from MCS: ref #1176330
2019-01-15 13:36:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:36:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176330  77 58498 48980621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:36:20 [DEBUG   ] Got command RPT from MCS: ref #1176331
2019-01-15 13:36:20 [DEBUG   ] summary = ERROR
2019-01-15 13:36:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176331  13 58498 48980813 A  ERRORERROR'
2019-01-15 13:36:21 [DEBUG   ] Got command RPT from MCS: ref #1176333
2019-01-15 13:36:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:36:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176333  77 58498 48981017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:36:21 [DEBUG   ] Got command RPT from MCS: ref #1176334
2019-01-15 13:36:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 13:36:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176334  12 58498 48981221 A  ERRORB˜™š'
2019-01-15 13:36:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:36:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:36:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:36:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:36:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:36:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:36:27 [DEBUG   ] Finished updating board flags in 1.755 seconds
2019-01-15 13:37:02 [INFO    ] __waitForTBW - TBW finished in 107.968 s
2019-01-15 13:37:03 [DEBUG   ] Finished updating ant stats in 0.387 seconds
2019-01-15 13:37:03 [INFO    ] Started antennas statistics background thread
2019-01-15 13:37:03 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547559425']
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547559425']
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547559425']
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547559425']
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547559425']
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547559425']
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547559425']
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547559425']
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547559425']
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547559425']
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547559425']
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547559425']
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547559425']
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547559425']
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547559425']
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547559425']
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547559425']
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547559425']
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547559425']
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547559425']
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547559425']
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547559425']
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547559425']
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547559425']
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547559425']
2019-01-15 13:37:03 [DEBUG   ] spawn_process: at 2019-01-15 13:37:03 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547559425']
2019-01-15 13:37:03 [INFO    ] Finished spawning TBN in 0.052 s
2019-01-15 13:37:24 [DEBUG   ] Finished updating ant stats in 1.270 seconds
2019-01-15 13:37:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-15 13:37:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:37:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 13:37:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-15 13:37:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:37:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:37:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:37:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:37:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:37:27 [DEBUG   ] Finished updating board flags in 1.786 seconds
2019-01-15 13:37:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 13:38:04 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 13:38:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 13:38:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:38:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:38:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:38:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:38:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:38:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:38:27 [DEBUG   ] Finished updating board flags in 1.624 seconds
2019-01-15 13:38:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 13:39:04 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 13:39:24 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 13:39:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:39:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:39:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:39:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:39:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:39:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:39:27 [DEBUG   ] Finished updating board flags in 1.630 seconds
2019-01-15 13:39:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 13:40:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 13:40:24 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 13:40:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:40:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 13:40:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:40:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:40:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:40:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:40:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:40:27 [DEBUG   ] Finished updating board flags in 1.630 seconds
2019-01-15 13:40:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 13:41:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 13:41:05 [DEBUG   ] Got command RPT from MCS: ref #1176347
2019-01-15 13:41:05 [DEBUG   ] summary = ERROR
2019-01-15 13:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176347  13 58498 49265017 A  ERRORERROR'
2019-01-15 13:41:05 [DEBUG   ] Got command RPT from MCS: ref #1176348
2019-01-15 13:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176348  77 58498 49265018 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:41:20 [DEBUG   ] Got command RPT from MCS: ref #1176364
2019-01-15 13:41:20 [DEBUG   ] summary = ERROR
2019-01-15 13:41:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176364  13 58498 49280497 A  ERRORERROR'
2019-01-15 13:41:20 [DEBUG   ] Got command RPT from MCS: ref #1176365
2019-01-15 13:41:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:41:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176365  77 58498 49280701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:41:20 [DEBUG   ] Got command RPT from MCS: ref #1176366
2019-01-15 13:41:20 [DEBUG   ] summary = ERROR
2019-01-15 13:41:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176366  13 58498 49280905 A  ERRORERROR'
2019-01-15 13:41:21 [DEBUG   ] Got command RPT from MCS: ref #1176367
2019-01-15 13:41:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:41:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176367  77 58498 49281097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:41:21 [DEBUG   ] Got command RPT from MCS: ref #1176368
2019-01-15 13:41:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 13:41:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176368  12 58498 49281301 A  ERRORB—™š'
2019-01-15 13:41:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 13:41:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:41:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:41:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:41:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:41:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:41:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:41:27 [DEBUG   ] Finished updating board flags in 1.625 seconds
2019-01-15 13:41:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 13:42:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 13:42:24 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 13:42:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:42:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:42:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:42:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:42:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:42:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:42:27 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-01-15 13:42:44 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 13:43:04 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 13:43:25 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-15 13:43:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:43:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:43:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:43:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:43:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:43:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:43:27 [DEBUG   ] Finished updating board flags in 1.628 seconds
2019-01-15 13:43:45 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 13:44:05 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 13:44:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 13:44:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:44:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:44:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:44:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:44:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:44:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:44:27 [DEBUG   ] Finished updating board flags in 1.622 seconds
2019-01-15 13:44:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 13:45:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 13:45:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 13:45:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:45:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 13:45:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:45:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:45:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:45:27 [WARNING ] (13, 1, 'bot')
2019-01-15 13:45:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:45:27 [DEBUG   ] Finished updating board flags in 1.629 seconds
2019-01-15 13:45:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 13:46:05 [DEBUG   ] Got command RPT from MCS: ref #1176377
2019-01-15 13:46:05 [DEBUG   ] summary = ERROR
2019-01-15 13:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176377  13 58498 49565017 A  ERRORERROR'
2019-01-15 13:46:05 [DEBUG   ] Got command RPT from MCS: ref #1176378
2019-01-15 13:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176378  77 58498 49565018 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:46:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 13:46:20 [DEBUG   ] Got command RPT from MCS: ref #1176396
2019-01-15 13:46:20 [DEBUG   ] summary = ERROR
2019-01-15 13:46:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176396  13 58498 49580581 A  ERRORERROR'
2019-01-15 13:46:20 [DEBUG   ] Got command RPT from MCS: ref #1176397
2019-01-15 13:46:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:46:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176397  77 58498 49580785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:46:20 [DEBUG   ] Got command RPT from MCS: ref #1176398
2019-01-15 13:46:20 [DEBUG   ] summary = ERROR
2019-01-15 13:46:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176398  13 58498 49580977 A  ERRORERROR'
2019-01-15 13:46:21 [DEBUG   ] Got command RPT from MCS: ref #1176400
2019-01-15 13:46:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:46:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176400  77 58498 49581181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:46:21 [DEBUG   ] Got command RPT from MCS: ref #1176402
2019-01-15 13:46:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 13:46:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176402  12 58498 49581385 A  ERRORB—™š'
2019-01-15 13:46:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 13:46:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:46:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 13:46:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:46:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:46:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:46:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:46:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:46:28 [DEBUG   ] Finished updating board flags in 1.632 seconds
2019-01-15 13:46:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 13:47:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 13:47:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 13:47:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:47:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 13:47:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:47:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:47:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:47:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:47:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:47:28 [DEBUG   ] Finished updating board flags in 1.627 seconds
2019-01-15 13:47:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 13:48:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 13:48:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 13:48:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:48:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:48:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:48:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:48:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:48:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:48:28 [DEBUG   ] Finished updating board flags in 2.337 seconds
2019-01-15 13:48:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 13:49:05 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 13:49:26 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-15 13:49:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:49:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:49:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:49:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:49:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:49:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:49:28 [DEBUG   ] Finished updating board flags in 2.085 seconds
2019-01-15 13:49:46 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 13:50:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 13:50:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 13:50:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:50:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:50:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:50:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:50:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:50:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:50:28 [DEBUG   ] Finished updating board flags in 1.981 seconds
2019-01-15 13:50:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 13:51:05 [DEBUG   ] Got command RPT from MCS: ref #1176414
2019-01-15 13:51:05 [DEBUG   ] summary = ERROR
2019-01-15 13:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176414  13 58498 49865021 A  ERRORERROR'
2019-01-15 13:51:05 [DEBUG   ] Got command RPT from MCS: ref #1176415
2019-01-15 13:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176415  77 58498 49865022 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:51:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 13:51:20 [DEBUG   ] Got command RPT from MCS: ref #1176431
2019-01-15 13:51:20 [DEBUG   ] summary = ERROR
2019-01-15 13:51:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176431  13 58498 49880657 A  ERRORERROR'
2019-01-15 13:51:20 [DEBUG   ] Got command RPT from MCS: ref #1176432
2019-01-15 13:51:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:51:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176432  77 58498 49880861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:51:21 [DEBUG   ] Got command RPT from MCS: ref #1176433
2019-01-15 13:51:21 [DEBUG   ] summary = ERROR
2019-01-15 13:51:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176433  13 58498 49881065 A  ERRORERROR'
2019-01-15 13:51:21 [DEBUG   ] Got command RPT from MCS: ref #1176434
2019-01-15 13:51:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:51:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176434  77 58498 49881257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:51:21 [DEBUG   ] Got command RPT from MCS: ref #1176435
2019-01-15 13:51:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 13:51:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176435  12 58498 49881461 A  ERRORB˜™š'
2019-01-15 13:51:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 13:51:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:51:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:51:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:51:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:51:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:51:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:51:28 [DEBUG   ] Finished updating board flags in 1.793 seconds
2019-01-15 13:51:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 13:52:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 13:52:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 13:52:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:52:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:52:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:52:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:52:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:52:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:52:28 [DEBUG   ] Finished updating board flags in 1.611 seconds
2019-01-15 13:52:46 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 13:53:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 13:53:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 13:53:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:53:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:53:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:53:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:53:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:53:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:53:28 [DEBUG   ] Finished updating board flags in 1.594 seconds
2019-01-15 13:53:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 13:54:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 13:54:27 [DEBUG   ] Finished updating ant stats in 1.599 seconds
2019-01-15 13:54:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:54:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:54:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:54:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:54:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:54:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:54:28 [DEBUG   ] Finished updating board flags in 1.424 seconds
2019-01-15 13:54:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 13:55:07 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 13:55:26 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-15 13:55:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:55:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:55:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:55:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:55:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:55:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:55:28 [DEBUG   ] Finished updating board flags in 1.380 seconds
2019-01-15 13:55:47 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2019-01-15 13:56:05 [DEBUG   ] Got command RPT from MCS: ref #1176447
2019-01-15 13:56:05 [DEBUG   ] summary = ERROR
2019-01-15 13:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176447  13 58498 50165025 A  ERRORERROR'
2019-01-15 13:56:05 [DEBUG   ] Got command RPT from MCS: ref #1176448
2019-01-15 13:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176448  77 58498 50165026 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:56:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 13:56:20 [DEBUG   ] Got command RPT from MCS: ref #1176469
2019-01-15 13:56:20 [DEBUG   ] summary = ERROR
2019-01-15 13:56:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176469  13 58498 50180745 A  ERRORERROR'
2019-01-15 13:56:20 [DEBUG   ] Got command RPT from MCS: ref #1176470
2019-01-15 13:56:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:56:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176470  77 58498 50180937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:56:21 [DEBUG   ] Got command RPT from MCS: ref #1176471
2019-01-15 13:56:21 [DEBUG   ] summary = ERROR
2019-01-15 13:56:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176471  13 58498 50181141 A  ERRORERROR'
2019-01-15 13:56:21 [DEBUG   ] Got command RPT from MCS: ref #1176473
2019-01-15 13:56:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 13:56:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176473  77 58498 50181345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 13:56:21 [DEBUG   ] Got command RPT from MCS: ref #1176475
2019-01-15 13:56:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 13:56:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176475  12 58498 50181549 A  ERRORB—™š'
2019-01-15 13:56:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 13:56:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:56:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:56:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:56:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:56:28 [WARNING ] (13, 1, 'bot')
2019-01-15 13:56:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:56:28 [DEBUG   ] Finished updating board flags in 1.361 seconds
2019-01-15 13:56:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 13:57:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 13:57:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 13:57:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:57:29 [WARNING ] (13, 1, 'bot')
2019-01-15 13:57:29 [WARNING ] (13, 1, 'bot')
2019-01-15 13:57:29 [WARNING ] (13, 1, 'bot')
2019-01-15 13:57:29 [WARNING ] (13, 1, 'bot')
2019-01-15 13:57:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:57:29 [DEBUG   ] Finished updating board flags in 2.059 seconds
2019-01-15 13:57:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 13:58:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 13:58:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 13:58:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:58:29 [WARNING ] (13, 1, 'bot')
2019-01-15 13:58:29 [WARNING ] (13, 1, 'bot')
2019-01-15 13:58:29 [WARNING ] (13, 1, 'bot')
2019-01-15 13:58:29 [WARNING ] (13, 1, 'bot')
2019-01-15 13:58:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:58:29 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-01-15 13:58:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 13:59:07 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 13:59:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 13:59:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 13:59:29 [WARNING ] (13, 1, 'bot')
2019-01-15 13:59:29 [WARNING ] (13, 1, 'bot')
2019-01-15 13:59:29 [WARNING ] (13, 1, 'bot')
2019-01-15 13:59:29 [WARNING ] (13, 1, 'bot')
2019-01-15 13:59:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 13:59:29 [DEBUG   ] Finished updating board flags in 1.807 seconds
2019-01-15 13:59:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 14:00:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 14:00:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 14:00:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:00:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:00:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:00:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:00:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:00:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:00:29 [DEBUG   ] Finished updating board flags in 1.789 seconds
2019-01-15 14:00:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 14:01:05 [DEBUG   ] Got command RPT from MCS: ref #1176487
2019-01-15 14:01:05 [DEBUG   ] summary = ERROR
2019-01-15 14:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176487  13 58498 50465025 A  ERRORERROR'
2019-01-15 14:01:05 [DEBUG   ] Got command RPT from MCS: ref #1176488
2019-01-15 14:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176488  77 58498 50465026 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:01:08 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 14:01:20 [DEBUG   ] Got command RPT from MCS: ref #1176504
2019-01-15 14:01:20 [DEBUG   ] summary = ERROR
2019-01-15 14:01:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176504  13 58498 50480817 A  ERRORERROR'
2019-01-15 14:01:21 [DEBUG   ] Got command RPT from MCS: ref #1176505
2019-01-15 14:01:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:01:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176505  77 58498 50481021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:01:21 [DEBUG   ] Got command RPT from MCS: ref #1176506
2019-01-15 14:01:21 [DEBUG   ] summary = ERROR
2019-01-15 14:01:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176506  13 58498 50481225 A  ERRORERROR'
2019-01-15 14:01:21 [DEBUG   ] Got command RPT from MCS: ref #1176507
2019-01-15 14:01:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:01:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176507  77 58498 50481429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:01:21 [DEBUG   ] Got command RPT from MCS: ref #1176508
2019-01-15 14:01:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 14:01:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176508  12 58498 50481621 A  ERRORB–™š'
2019-01-15 14:01:28 [DEBUG   ] Finished updating ant stats in 1.255 seconds
2019-01-15 14:01:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:01:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:01:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:01:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:01:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:01:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:01:29 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-15 14:01:48 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2019-01-15 14:02:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 14:02:28 [DEBUG   ] Finished updating ant stats in 1.051 seconds
2019-01-15 14:02:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:02:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 14:02:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:02:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:02:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:02:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:02:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:02:29 [DEBUG   ] Finished updating board flags in 1.590 seconds
2019-01-15 14:02:48 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2019-01-15 14:03:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 14:03:28 [DEBUG   ] Finished updating ant stats in 0.649 seconds
2019-01-15 14:03:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:03:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:03:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:03:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:03:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:03:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:03:29 [DEBUG   ] Finished updating board flags in 1.423 seconds
2019-01-15 14:03:48 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2019-01-15 14:04:09 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 14:04:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:04:29 [DEBUG   ] Finished updating ant stats in 1.252 seconds
2019-01-15 14:04:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:04:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:04:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:04:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:04:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:04:29 [DEBUG   ] Finished updating board flags in 1.442 seconds
2019-01-15 14:04:49 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2019-01-15 14:05:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 14:05:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:05:29 [DEBUG   ] Finished updating ant stats in 1.044 seconds
2019-01-15 14:05:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:05:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:05:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:05:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:05:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:05:29 [DEBUG   ] Finished updating board flags in 1.449 seconds
2019-01-15 14:05:49 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2019-01-15 14:06:05 [DEBUG   ] Got command RPT from MCS: ref #1176517
2019-01-15 14:06:05 [DEBUG   ] summary = ERROR
2019-01-15 14:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176517  13 58498 50765025 A  ERRORERROR'
2019-01-15 14:06:05 [DEBUG   ] Got command RPT from MCS: ref #1176518
2019-01-15 14:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176518  77 58498 50765026 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:06:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 14:06:20 [DEBUG   ] Got command RPT from MCS: ref #1176536
2019-01-15 14:06:20 [DEBUG   ] summary = ERROR
2019-01-15 14:06:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176536  13 58498 50780901 A  ERRORERROR'
2019-01-15 14:06:21 [DEBUG   ] Got command RPT from MCS: ref #1176537
2019-01-15 14:06:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:06:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176537  77 58498 50781105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:06:21 [DEBUG   ] Got command RPT from MCS: ref #1176538
2019-01-15 14:06:21 [DEBUG   ] summary = ERROR
2019-01-15 14:06:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176538  13 58498 50781309 A  ERRORERROR'
2019-01-15 14:06:21 [DEBUG   ] Got command RPT from MCS: ref #1176540
2019-01-15 14:06:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:06:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176540  77 58498 50781501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:06:21 [DEBUG   ] Got command RPT from MCS: ref #1176541
2019-01-15 14:06:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 14:06:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176541  12 58498 50781705 A  ERRORB—™š'
2019-01-15 14:06:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:06:29 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2019-01-15 14:06:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:06:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:06:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:06:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:06:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:06:29 [DEBUG   ] Finished updating board flags in 1.449 seconds
2019-01-15 14:06:49 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2019-01-15 14:07:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 14:07:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:07:29 [DEBUG   ] Finished updating ant stats in 0.649 seconds
2019-01-15 14:07:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:07:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:07:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:07:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:07:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:07:29 [DEBUG   ] Finished updating board flags in 1.430 seconds
2019-01-15 14:07:49 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2019-01-15 14:08:10 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 14:08:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:08:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:08:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:08:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:08:29 [WARNING ] (13, 1, 'bot')
2019-01-15 14:08:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:08:29 [DEBUG   ] Finished updating board flags in 1.385 seconds
2019-01-15 14:08:30 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 14:08:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 14:09:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 14:09:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 14:09:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:09:30 [DEBUG   ] Finished updating ant stats in 1.049 seconds
2019-01-15 14:09:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:09:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:09:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:09:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:09:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:09:30 [DEBUG   ] Finished updating board flags in 2.112 seconds
2019-01-15 14:09:50 [DEBUG   ] Finished updating ant stats in 0.957 seconds
2019-01-15 14:10:10 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 14:10:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:10:30 [DEBUG   ] Finished updating ant stats in 0.642 seconds
2019-01-15 14:10:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:10:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:10:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:10:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:10:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:10:30 [DEBUG   ] Finished updating board flags in 1.977 seconds
2019-01-15 14:10:50 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2019-01-15 14:11:05 [DEBUG   ] Got command RPT from MCS: ref #1176550
2019-01-15 14:11:05 [DEBUG   ] summary = ERROR
2019-01-15 14:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176550  13 58498 51065025 A  ERRORERROR'
2019-01-15 14:11:05 [DEBUG   ] Got command RPT from MCS: ref #1176551
2019-01-15 14:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176551  77 58498 51065026 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:11:11 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 14:11:20 [DEBUG   ] Got command RPT from MCS: ref #1176567
2019-01-15 14:11:20 [DEBUG   ] summary = ERROR
2019-01-15 14:11:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176567  13 58498 51080989 A  ERRORERROR'
2019-01-15 14:11:21 [DEBUG   ] Got command RPT from MCS: ref #1176568
2019-01-15 14:11:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:11:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176568  77 58498 51081181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:11:21 [DEBUG   ] Got command RPT from MCS: ref #1176569
2019-01-15 14:11:21 [DEBUG   ] summary = ERROR
2019-01-15 14:11:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176569  13 58498 51081385 A  ERRORERROR'
2019-01-15 14:11:21 [DEBUG   ] Got command RPT from MCS: ref #1176570
2019-01-15 14:11:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:11:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176570  77 58498 51081589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:11:21 [DEBUG   ] Got command RPT from MCS: ref #1176571
2019-01-15 14:11:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 14:11:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176571  12 58498 51081793 A  ERRORB—™š'
2019-01-15 14:11:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:11:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:11:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:11:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:11:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:11:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:11:30 [DEBUG   ] Finished updating board flags in 1.805 seconds
2019-01-15 14:11:31 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 14:11:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 14:12:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 14:12:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:12:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:12:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:12:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:12:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:12:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:12:30 [DEBUG   ] Finished updating board flags in 1.788 seconds
2019-01-15 14:12:31 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-01-15 14:12:51 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 14:13:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 14:13:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:13:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:13:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:13:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:13:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:13:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:13:30 [DEBUG   ] Finished updating board flags in 1.611 seconds
2019-01-15 14:13:31 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 14:13:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 14:14:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 14:14:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:14:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:14:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:14:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:14:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:14:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:14:30 [DEBUG   ] Finished updating board flags in 1.553 seconds
2019-01-15 14:14:31 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 14:14:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 14:15:11 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-01-15 14:15:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:15:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:15:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:15:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:15:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:15:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:15:30 [DEBUG   ] Finished updating board flags in 1.398 seconds
2019-01-15 14:15:31 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-15 14:15:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 14:16:05 [DEBUG   ] Got command RPT from MCS: ref #1176580
2019-01-15 14:16:05 [DEBUG   ] summary = ERROR
2019-01-15 14:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176580  13 58498 51365029 A  ERRORERROR'
2019-01-15 14:16:05 [DEBUG   ] Got command RPT from MCS: ref #1176581
2019-01-15 14:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176581  77 58498 51365030 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:16:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 14:16:21 [DEBUG   ] Got command RPT from MCS: ref #1176599
2019-01-15 14:16:21 [DEBUG   ] summary = ERROR
2019-01-15 14:16:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176599  13 58498 51381061 A  ERRORERROR'
2019-01-15 14:16:21 [DEBUG   ] Got command RPT from MCS: ref #1176600
2019-01-15 14:16:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:16:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176600  77 58498 51381265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:16:21 [DEBUG   ] Got command RPT from MCS: ref #1176601
2019-01-15 14:16:21 [DEBUG   ] summary = ERROR
2019-01-15 14:16:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176601  13 58498 51381469 A  ERRORERROR'
2019-01-15 14:16:21 [DEBUG   ] Got command RPT from MCS: ref #1176603
2019-01-15 14:16:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:16:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176603  77 58498 51381673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:16:21 [DEBUG   ] Got command RPT from MCS: ref #1176604
2019-01-15 14:16:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 14:16:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176604  12 58498 51381865 A  ERRORB–™š'
2019-01-15 14:16:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:16:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:16:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:16:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:16:30 [WARNING ] (13, 1, 'bot')
2019-01-15 14:16:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:16:30 [DEBUG   ] Finished updating board flags in 1.351 seconds
2019-01-15 14:16:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 14:16:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 14:17:12 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 14:17:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:17:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:17:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:17:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:17:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:17:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:17:31 [DEBUG   ] Finished updating board flags in 2.110 seconds
2019-01-15 14:17:32 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-01-15 14:17:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 14:18:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 14:18:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:18:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:18:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:18:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:18:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:18:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:18:31 [DEBUG   ] Finished updating board flags in 1.990 seconds
2019-01-15 14:18:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 14:18:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 14:19:12 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 14:19:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:19:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:19:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:19:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:19:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:19:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:19:31 [DEBUG   ] Finished updating board flags in 1.756 seconds
2019-01-15 14:19:33 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-15 14:19:53 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 14:20:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 14:20:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 14:20:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:20:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:20:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:20:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:20:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:20:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:20:31 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-01-15 14:20:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 14:20:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 14:21:05 [DEBUG   ] Got command RPT from MCS: ref #1176617
2019-01-15 14:21:05 [DEBUG   ] summary = ERROR
2019-01-15 14:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176617  13 58498 51665025 A  ERRORERROR'
2019-01-15 14:21:05 [DEBUG   ] Got command RPT from MCS: ref #1176618
2019-01-15 14:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176618  77 58498 51665026 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:21:13 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 14:21:21 [DEBUG   ] Got command RPT from MCS: ref #1176634
2019-01-15 14:21:21 [DEBUG   ] summary = ERROR
2019-01-15 14:21:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176634  13 58498 51681141 A  ERRORERROR'
2019-01-15 14:21:21 [DEBUG   ] Got command RPT from MCS: ref #1176635
2019-01-15 14:21:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:21:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176635  77 58498 51681345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:21:21 [DEBUG   ] Got command RPT from MCS: ref #1176636
2019-01-15 14:21:21 [DEBUG   ] summary = ERROR
2019-01-15 14:21:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176636  13 58498 51681549 A  ERRORERROR'
2019-01-15 14:21:21 [DEBUG   ] Got command RPT from MCS: ref #1176637
2019-01-15 14:21:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:21:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176637  77 58498 51681753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:21:21 [DEBUG   ] Got command RPT from MCS: ref #1176638
2019-01-15 14:21:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 14:21:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176638  12 58498 51681945 A  ERRORB—™š'
2019-01-15 14:21:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:21:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:21:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:21:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:21:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:21:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:21:31 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-01-15 14:21:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 14:21:53 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 14:22:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 14:22:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:22:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:22:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:22:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:22:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:22:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:22:31 [DEBUG   ] Finished updating board flags in 1.582 seconds
2019-01-15 14:22:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 14:22:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 14:23:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 14:23:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:23:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:23:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:23:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:23:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:23:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:23:31 [DEBUG   ] Finished updating board flags in 1.406 seconds
2019-01-15 14:23:33 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-01-15 14:23:53 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 14:24:14 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-15 14:24:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:24:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 14:24:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:24:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:24:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:24:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:24:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:24:31 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-01-15 14:24:33 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 14:24:54 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 14:25:14 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 14:25:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:25:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:25:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:25:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:25:31 [WARNING ] (13, 1, 'bot')
2019-01-15 14:25:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:25:31 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-01-15 14:25:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 14:25:54 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 14:26:05 [DEBUG   ] Got command RPT from MCS: ref #1176643
2019-01-15 14:26:05 [DEBUG   ] summary = ERROR
2019-01-15 14:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176643  13 58498 51965029 A  ERRORERROR'
2019-01-15 14:26:05 [DEBUG   ] Got command RPT from MCS: ref #1176644
2019-01-15 14:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176644  77 58498 51965030 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:26:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 14:26:21 [DEBUG   ] Got command RPT from MCS: ref #1176662
2019-01-15 14:26:21 [DEBUG   ] summary = ERROR
2019-01-15 14:26:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176662  13 58498 51981221 A  ERRORERROR'
2019-01-15 14:26:21 [DEBUG   ] Got command RPT from MCS: ref #1176663
2019-01-15 14:26:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:26:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176663  77 58498 51981425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:26:21 [DEBUG   ] Got command RPT from MCS: ref #1176664
2019-01-15 14:26:21 [DEBUG   ] summary = ERROR
2019-01-15 14:26:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176664  13 58498 51981629 A  ERRORERROR'
2019-01-15 14:26:21 [DEBUG   ] Got command RPT from MCS: ref #1176666
2019-01-15 14:26:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:26:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176666  77 58498 51981833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:26:22 [DEBUG   ] Got command RPT from MCS: ref #1176668
2019-01-15 14:26:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 14:26:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176668  12 58498 51982025 A  ERRORB—™š'
2019-01-15 14:26:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:26:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 14:26:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:26:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:26:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:26:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:26:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:26:32 [DEBUG   ] Finished updating board flags in 2.214 seconds
2019-01-15 14:26:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 14:26:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 14:27:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 14:27:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:27:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 14:27:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:27:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:27:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:27:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:27:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:27:32 [DEBUG   ] Finished updating board flags in 2.231 seconds
2019-01-15 14:27:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 14:27:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 14:28:14 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 14:28:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:28:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 14:28:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:28:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:28:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:28:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:28:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:28:32 [DEBUG   ] Finished updating board flags in 2.171 seconds
2019-01-15 14:28:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 14:28:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 14:29:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 14:29:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:29:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:29:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:29:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:29:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:29:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:29:32 [DEBUG   ] Finished updating board flags in 1.991 seconds
2019-01-15 14:29:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 14:29:54 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 14:30:15 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 14:30:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:30:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:30:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:30:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:30:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:30:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:30:32 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-01-15 14:30:35 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 14:30:55 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 14:31:05 [DEBUG   ] Got command RPT from MCS: ref #1176680
2019-01-15 14:31:05 [DEBUG   ] summary = ERROR
2019-01-15 14:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176680  13 58498 52265033 A  ERRORERROR'
2019-01-15 14:31:05 [DEBUG   ] Got command RPT from MCS: ref #1176681
2019-01-15 14:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176681  77 58498 52265034 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:31:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 14:31:21 [DEBUG   ] Got command RPT from MCS: ref #1176697
2019-01-15 14:31:21 [DEBUG   ] summary = ERROR
2019-01-15 14:31:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176697  13 58498 52281306 A  ERRORERROR'
2019-01-15 14:31:21 [DEBUG   ] Got command RPT from MCS: ref #1176698
2019-01-15 14:31:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:31:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176698  77 58498 52281509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:31:21 [DEBUG   ] Got command RPT from MCS: ref #1176699
2019-01-15 14:31:21 [DEBUG   ] summary = ERROR
2019-01-15 14:31:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176699  13 58498 52281713 A  ERRORERROR'
2019-01-15 14:31:21 [DEBUG   ] Got command RPT from MCS: ref #1176700
2019-01-15 14:31:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:31:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176700  77 58498 52281906 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:31:22 [DEBUG   ] Got command RPT from MCS: ref #1176701
2019-01-15 14:31:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 14:31:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176701  12 58498 52282110 A  ERRORB–™š'
2019-01-15 14:31:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:31:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 14:31:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:31:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:31:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:31:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:31:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:31:32 [DEBUG   ] Finished updating board flags in 1.779 seconds
2019-01-15 14:31:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 14:31:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 14:32:15 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 14:32:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:32:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:32:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:32:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:32:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:32:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:32:32 [DEBUG   ] Finished updating board flags in 1.661 seconds
2019-01-15 14:32:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 14:32:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 14:33:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 14:33:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:33:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:33:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:33:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:33:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:33:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:33:32 [DEBUG   ] Finished updating board flags in 1.545 seconds
2019-01-15 14:33:35 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 14:33:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 14:34:15 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 14:34:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:34:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:34:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:34:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:34:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:34:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:34:32 [DEBUG   ] Finished updating board flags in 1.408 seconds
2019-01-15 14:34:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 14:34:55 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-01-15 14:35:16 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 14:35:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:35:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:35:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:35:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:35:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:35:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:35:32 [DEBUG   ] Finished updating board flags in 1.399 seconds
2019-01-15 14:35:36 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 14:35:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 14:36:05 [DEBUG   ] Got command RPT from MCS: ref #1176710
2019-01-15 14:36:05 [DEBUG   ] summary = ERROR
2019-01-15 14:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176710  13 58498 52565025 A  ERRORERROR'
2019-01-15 14:36:05 [DEBUG   ] Got command RPT from MCS: ref #1176711
2019-01-15 14:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176711  77 58498 52565026 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:36:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 14:36:21 [DEBUG   ] Got command RPT from MCS: ref #1176729
2019-01-15 14:36:21 [DEBUG   ] summary = ERROR
2019-01-15 14:36:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176729  13 58498 52581381 A  ERRORERROR'
2019-01-15 14:36:21 [DEBUG   ] Got command RPT from MCS: ref #1176730
2019-01-15 14:36:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:36:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176730  77 58498 52581585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:36:21 [DEBUG   ] Got command RPT from MCS: ref #1176731
2019-01-15 14:36:21 [DEBUG   ] summary = ERROR
2019-01-15 14:36:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176731  13 58498 52581789 A  ERRORERROR'
2019-01-15 14:36:21 [DEBUG   ] Got command RPT from MCS: ref #1176732
2019-01-15 14:36:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:36:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176732  77 58498 52581993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:36:22 [DEBUG   ] Got command RPT from MCS: ref #1176734
2019-01-15 14:36:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 14:36:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176734  12 58498 52582185 A  ERRORB•™š'
2019-01-15 14:36:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 14:36:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:36:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:36:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:36:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:36:32 [WARNING ] (13, 1, 'bot')
2019-01-15 14:36:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:36:32 [DEBUG   ] Finished updating board flags in 1.354 seconds
2019-01-15 14:36:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 14:36:56 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 14:37:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 14:37:32 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 14:37:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:37:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 14:37:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:37:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:37:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:37:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:37:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:37:33 [DEBUG   ] Finished updating board flags in 2.082 seconds
2019-01-15 14:37:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 14:37:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 14:38:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 14:38:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:38:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-15 14:38:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:38:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:38:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:38:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:38:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:38:33 [DEBUG   ] Finished updating board flags in 2.014 seconds
2019-01-15 14:38:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 14:38:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 14:39:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 14:39:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:39:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:39:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:39:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:39:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:39:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:39:33 [DEBUG   ] Finished updating board flags in 1.980 seconds
2019-01-15 14:39:36 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 14:39:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 14:40:17 [DEBUG   ] Finished updating ant stats in 1.405 seconds
2019-01-15 14:40:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:40:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:40:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:40:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:40:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:40:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:40:33 [DEBUG   ] Finished updating board flags in 1.819 seconds
2019-01-15 14:40:37 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-15 14:40:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 14:41:05 [DEBUG   ] Got command RPT from MCS: ref #1176743
2019-01-15 14:41:05 [DEBUG   ] summary = ERROR
2019-01-15 14:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176743  13 58498 52865033 A  ERRORERROR'
2019-01-15 14:41:05 [DEBUG   ] Got command RPT from MCS: ref #1176744
2019-01-15 14:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176744  77 58498 52865034 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:41:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 14:41:21 [DEBUG   ] Got command RPT from MCS: ref #1176760
2019-01-15 14:41:21 [DEBUG   ] summary = ERROR
2019-01-15 14:41:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176760  13 58498 52881465 A  ERRORERROR'
2019-01-15 14:41:21 [DEBUG   ] Got command RPT from MCS: ref #1176761
2019-01-15 14:41:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:41:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176761  77 58498 52881669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:41:21 [DEBUG   ] Got command RPT from MCS: ref #1176762
2019-01-15 14:41:21 [DEBUG   ] summary = ERROR
2019-01-15 14:41:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176762  13 58498 52881873 A  ERRORERROR'
2019-01-15 14:41:22 [DEBUG   ] Got command RPT from MCS: ref #1176763
2019-01-15 14:41:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:41:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176763  77 58498 52882065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:41:22 [DEBUG   ] Got command RPT from MCS: ref #1176764
2019-01-15 14:41:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 14:41:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176764  12 58498 52882269 A  ERRORB˜™š'
2019-01-15 14:41:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:41:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:41:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:41:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:41:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:41:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:41:33 [DEBUG   ] Finished updating board flags in 1.775 seconds
2019-01-15 14:41:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 14:41:57 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 14:42:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 14:42:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 14:42:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:42:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:42:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:42:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:42:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:42:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:42:33 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-01-15 14:42:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 14:42:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 14:43:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 14:43:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:43:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:43:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:43:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:43:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:43:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:43:33 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-15 14:43:37 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 14:43:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 14:44:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 14:44:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:44:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:44:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:44:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:44:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:44:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:44:33 [DEBUG   ] Finished updating board flags in 1.577 seconds
2019-01-15 14:44:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 14:44:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 14:45:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 14:45:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:45:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:45:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:45:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:45:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:45:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:45:33 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-01-15 14:45:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 14:45:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 14:46:05 [DEBUG   ] Got command RPT from MCS: ref #1176773
2019-01-15 14:46:05 [DEBUG   ] summary = ERROR
2019-01-15 14:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176773  13 58498 53165033 A  ERRORERROR'
2019-01-15 14:46:05 [DEBUG   ] Got command RPT from MCS: ref #1176774
2019-01-15 14:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176774  77 58498 53165034 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:46:17 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 14:46:21 [DEBUG   ] Got command RPT from MCS: ref #1176792
2019-01-15 14:46:21 [DEBUG   ] summary = ERROR
2019-01-15 14:46:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176792  13 58498 53181545 A  ERRORERROR'
2019-01-15 14:46:21 [DEBUG   ] Got command RPT from MCS: ref #1176793
2019-01-15 14:46:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:46:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176793  77 58498 53181749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:46:21 [DEBUG   ] Got command RPT from MCS: ref #1176794
2019-01-15 14:46:21 [DEBUG   ] summary = ERROR
2019-01-15 14:46:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176794  13 58498 53181953 A  ERRORERROR'
2019-01-15 14:46:22 [DEBUG   ] Got command RPT from MCS: ref #1176796
2019-01-15 14:46:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:46:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176796  77 58498 53182145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:46:22 [DEBUG   ] Got command RPT from MCS: ref #1176797
2019-01-15 14:46:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 14:46:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176797  12 58498 53182349 A  ERRORB—™š'
2019-01-15 14:46:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:46:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:46:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:46:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:46:33 [WARNING ] (13, 1, 'bot')
2019-01-15 14:46:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:46:33 [DEBUG   ] Finished updating board flags in 1.386 seconds
2019-01-15 14:46:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 14:46:57 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 14:47:18 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 14:47:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:47:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:47:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:47:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:47:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:47:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:47:34 [DEBUG   ] Finished updating board flags in 2.225 seconds
2019-01-15 14:47:38 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 14:47:58 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 14:48:18 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 14:48:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:48:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:48:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:48:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:48:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:48:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:48:34 [DEBUG   ] Finished updating board flags in 2.175 seconds
2019-01-15 14:48:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 14:48:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 14:49:18 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 14:49:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:49:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:49:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:49:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:49:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:49:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:49:34 [DEBUG   ] Finished updating board flags in 2.016 seconds
2019-01-15 14:49:38 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 14:49:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 14:50:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 14:50:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:50:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:50:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:50:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:50:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:50:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:50:34 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-01-15 14:50:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 14:50:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 14:51:05 [DEBUG   ] Got command RPT from MCS: ref #1176810
2019-01-15 14:51:05 [DEBUG   ] summary = ERROR
2019-01-15 14:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176810  13 58498 53465033 A  ERRORERROR'
2019-01-15 14:51:05 [DEBUG   ] Got command RPT from MCS: ref #1176811
2019-01-15 14:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176811  77 58498 53465034 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:51:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 14:51:21 [DEBUG   ] Got command RPT from MCS: ref #1176827
2019-01-15 14:51:21 [DEBUG   ] summary = ERROR
2019-01-15 14:51:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176827  13 58498 53481633 A  ERRORERROR'
2019-01-15 14:51:21 [DEBUG   ] Got command RPT from MCS: ref #1176828
2019-01-15 14:51:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:51:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176828  77 58498 53481825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:51:22 [DEBUG   ] Got command RPT from MCS: ref #1176829
2019-01-15 14:51:22 [DEBUG   ] summary = ERROR
2019-01-15 14:51:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176829  13 58498 53482029 A  ERRORERROR'
2019-01-15 14:51:22 [DEBUG   ] Got command RPT from MCS: ref #1176830
2019-01-15 14:51:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:51:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176830  77 58498 53482233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:51:22 [DEBUG   ] Got command RPT from MCS: ref #1176831
2019-01-15 14:51:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 14:51:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176831  12 58498 53482437 A  ERRORB–™š'
2019-01-15 14:51:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:51:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:51:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:51:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:51:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:51:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:51:34 [DEBUG   ] Finished updating board flags in 1.819 seconds
2019-01-15 14:51:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 14:51:58 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 14:52:18 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 14:52:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:52:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:52:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:52:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:52:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:52:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:52:34 [DEBUG   ] Finished updating board flags in 1.783 seconds
2019-01-15 14:52:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 14:52:59 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 14:53:19 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 14:53:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:53:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:53:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:53:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:53:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:53:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:53:34 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-15 14:53:39 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 14:53:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 14:54:19 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 14:54:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:54:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:54:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:54:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:54:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:54:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:54:34 [DEBUG   ] Finished updating board flags in 1.599 seconds
2019-01-15 14:54:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 14:54:59 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 14:55:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 14:55:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:55:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:55:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:55:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:55:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:55:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:55:34 [DEBUG   ] Finished updating board flags in 1.396 seconds
2019-01-15 14:55:39 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 14:55:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 14:56:05 [DEBUG   ] Got command RPT from MCS: ref #1176836
2019-01-15 14:56:05 [DEBUG   ] summary = ERROR
2019-01-15 14:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176836  13 58498 53765037 A  ERRORERROR'
2019-01-15 14:56:05 [DEBUG   ] Got command RPT from MCS: ref #1176837
2019-01-15 14:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176837  77 58498 53765038 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:56:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 14:56:21 [DEBUG   ] Got command RPT from MCS: ref #1176855
2019-01-15 14:56:21 [DEBUG   ] summary = ERROR
2019-01-15 14:56:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176855  13 58498 53781705 A  ERRORERROR'
2019-01-15 14:56:21 [DEBUG   ] Got command RPT from MCS: ref #1176856
2019-01-15 14:56:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:56:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176856  77 58498 53781909 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:56:22 [DEBUG   ] Got command RPT from MCS: ref #1176857
2019-01-15 14:56:22 [DEBUG   ] summary = ERROR
2019-01-15 14:56:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176857  13 58498 53782113 A  ERRORERROR'
2019-01-15 14:56:22 [DEBUG   ] Got command RPT from MCS: ref #1176859
2019-01-15 14:56:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 14:56:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176859  77 58498 53782317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 14:56:22 [DEBUG   ] Got command RPT from MCS: ref #1176861
2019-01-15 14:56:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 14:56:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176861  12 58498 53782509 A  ERRORB—™š'
2019-01-15 14:56:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:56:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:56:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:56:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:56:34 [WARNING ] (13, 1, 'bot')
2019-01-15 14:56:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:56:34 [DEBUG   ] Finished updating board flags in 1.364 seconds
2019-01-15 14:56:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 14:56:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 14:57:19 [DEBUG   ] Finished updating ant stats in 0.788 seconds
2019-01-15 14:57:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:57:35 [WARNING ] (13, 1, 'bot')
2019-01-15 14:57:35 [WARNING ] (13, 1, 'bot')
2019-01-15 14:57:35 [WARNING ] (13, 1, 'bot')
2019-01-15 14:57:35 [WARNING ] (13, 1, 'bot')
2019-01-15 14:57:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:57:35 [DEBUG   ] Finished updating board flags in 2.048 seconds
2019-01-15 14:57:39 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 14:58:00 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 14:58:20 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 14:58:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:58:35 [WARNING ] (13, 1, 'bot')
2019-01-15 14:58:35 [WARNING ] (13, 1, 'bot')
2019-01-15 14:58:35 [WARNING ] (13, 1, 'bot')
2019-01-15 14:58:35 [WARNING ] (13, 1, 'bot')
2019-01-15 14:58:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:58:35 [DEBUG   ] Finished updating board flags in 2.010 seconds
2019-01-15 14:58:40 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 14:59:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 14:59:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 14:59:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 14:59:35 [WARNING ] (13, 1, 'bot')
2019-01-15 14:59:35 [WARNING ] (13, 1, 'bot')
2019-01-15 14:59:35 [WARNING ] (13, 1, 'bot')
2019-01-15 14:59:35 [WARNING ] (13, 1, 'bot')
2019-01-15 14:59:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 14:59:35 [DEBUG   ] Finished updating board flags in 1.984 seconds
2019-01-15 14:59:40 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-01-15 15:00:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 15:00:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 15:00:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:00:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:00:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:00:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:00:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:00:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:00:35 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-01-15 15:00:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 15:01:00 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-01-15 15:01:05 [DEBUG   ] Got command RPT from MCS: ref #1176873
2019-01-15 15:01:05 [DEBUG   ] summary = ERROR
2019-01-15 15:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176873  13 58498 54065029 A  ERRORERROR'
2019-01-15 15:01:05 [DEBUG   ] Got command RPT from MCS: ref #1176874
2019-01-15 15:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176874  77 58498 54065030 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:01:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 15:01:21 [DEBUG   ] Got command RPT from MCS: ref #1176890
2019-01-15 15:01:21 [DEBUG   ] summary = ERROR
2019-01-15 15:01:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176890  13 58498 54081793 A  ERRORERROR'
2019-01-15 15:01:21 [DEBUG   ] Got command RPT from MCS: ref #1176891
2019-01-15 15:01:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:01:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176891  77 58498 54081997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:01:22 [DEBUG   ] Got command RPT from MCS: ref #1176892
2019-01-15 15:01:22 [DEBUG   ] summary = ERROR
2019-01-15 15:01:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176892  13 58498 54082189 A  ERRORERROR'
2019-01-15 15:01:22 [DEBUG   ] Got command RPT from MCS: ref #1176893
2019-01-15 15:01:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:01:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176893  77 58498 54082393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:01:22 [DEBUG   ] Got command RPT from MCS: ref #1176894
2019-01-15 15:01:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 15:01:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176894  12 58498 54082597 A  ERRORB–™š'
2019-01-15 15:01:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:01:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:01:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:01:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:01:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:01:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:01:35 [DEBUG   ] Finished updating board flags in 1.788 seconds
2019-01-15 15:01:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 15:02:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 15:02:20 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 15:02:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:02:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:02:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:02:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:02:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:02:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:02:35 [DEBUG   ] Finished updating board flags in 1.678 seconds
2019-01-15 15:02:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 15:03:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 15:03:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 15:03:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:03:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:03:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:03:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:03:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:03:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:03:35 [DEBUG   ] Finished updating board flags in 1.528 seconds
2019-01-15 15:03:40 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 15:04:01 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-15 15:04:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 15:04:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:04:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:04:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:04:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:04:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:04:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:04:35 [DEBUG   ] Finished updating board flags in 1.419 seconds
2019-01-15 15:04:41 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 15:05:01 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-01-15 15:05:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 15:05:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:05:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:05:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:05:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:05:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:05:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:05:35 [DEBUG   ] Finished updating board flags in 1.385 seconds
2019-01-15 15:05:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 15:06:01 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 15:06:05 [DEBUG   ] Got command RPT from MCS: ref #1176903
2019-01-15 15:06:05 [DEBUG   ] summary = ERROR
2019-01-15 15:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176903  13 58498 54365037 A  ERRORERROR'
2019-01-15 15:06:05 [DEBUG   ] Got command RPT from MCS: ref #1176904
2019-01-15 15:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176904  77 58498 54365038 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:06:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 15:06:21 [DEBUG   ] Got command RPT from MCS: ref #1176922
2019-01-15 15:06:21 [DEBUG   ] summary = ERROR
2019-01-15 15:06:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176922  13 58498 54381873 A  ERRORERROR'
2019-01-15 15:06:22 [DEBUG   ] Got command RPT from MCS: ref #1176923
2019-01-15 15:06:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:06:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176923  77 58498 54382077 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:06:22 [DEBUG   ] Got command RPT from MCS: ref #1176924
2019-01-15 15:06:22 [DEBUG   ] summary = ERROR
2019-01-15 15:06:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176924  13 58498 54382269 A  ERRORERROR'
2019-01-15 15:06:22 [DEBUG   ] Got command RPT from MCS: ref #1176926
2019-01-15 15:06:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:06:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176926  77 58498 54382473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:06:22 [DEBUG   ] Got command RPT from MCS: ref #1176927
2019-01-15 15:06:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 15:06:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176927  12 58498 54382677 A  ERRORB•™š'
2019-01-15 15:06:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:06:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:06:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:06:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:06:35 [WARNING ] (13, 1, 'bot')
2019-01-15 15:06:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:06:35 [DEBUG   ] Finished updating board flags in 1.381 seconds
2019-01-15 15:06:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 15:07:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 15:07:21 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 15:07:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-15 15:07:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:07:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:07:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:07:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:07:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:07:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:07:36 [DEBUG   ] Finished updating board flags in 2.039 seconds
2019-01-15 15:07:42 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 15:08:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 15:08:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 15:08:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:08:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:08:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:08:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:08:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:08:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:08:36 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-01-15 15:08:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 15:09:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 15:09:22 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 15:09:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 15:09:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:09:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:09:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:09:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:09:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:09:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:09:36 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-01-15 15:09:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 15:10:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 15:10:22 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 15:10:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:10:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 15:10:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:10:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:10:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:10:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:10:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:10:36 [DEBUG   ] Finished updating board flags in 1.795 seconds
2019-01-15 15:10:42 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-01-15 15:11:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 15:11:05 [DEBUG   ] Got command RPT from MCS: ref #1176936
2019-01-15 15:11:05 [DEBUG   ] summary = ERROR
2019-01-15 15:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176936  13 58498 54665037 A  ERRORERROR'
2019-01-15 15:11:05 [DEBUG   ] Got command RPT from MCS: ref #1176937
2019-01-15 15:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176937  77 58498 54665038 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:11:21 [DEBUG   ] Got command RPT from MCS: ref #1176953
2019-01-15 15:11:21 [DEBUG   ] summary = ERROR
2019-01-15 15:11:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176953  13 58498 54681957 A  ERRORERROR'
2019-01-15 15:11:22 [DEBUG   ] Got command RPT from MCS: ref #1176954
2019-01-15 15:11:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:11:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176954  77 58498 54682161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:11:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 15:11:22 [DEBUG   ] Got command RPT from MCS: ref #1176955
2019-01-15 15:11:22 [DEBUG   ] summary = ERROR
2019-01-15 15:11:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176955  13 58498 54682353 A  ERRORERROR'
2019-01-15 15:11:22 [DEBUG   ] Got command RPT from MCS: ref #1176956
2019-01-15 15:11:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:11:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176956  77 58498 54682557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:11:22 [DEBUG   ] Got command RPT from MCS: ref #1176957
2019-01-15 15:11:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 15:11:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176957  12 58498 54682761 A  ERRORB—™š'
2019-01-15 15:11:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:11:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:11:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:11:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:11:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:11:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:11:36 [DEBUG   ] Finished updating board flags in 1.603 seconds
2019-01-15 15:11:42 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 15:12:02 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 15:12:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 15:12:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:12:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:12:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:12:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:12:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:12:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:12:36 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-01-15 15:12:43 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 15:13:02 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 15:13:23 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-15 15:13:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:13:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:13:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:13:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:13:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:13:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:13:36 [DEBUG   ] Finished updating board flags in 1.606 seconds
2019-01-15 15:13:43 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 15:14:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 15:14:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 15:14:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:14:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:14:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:14:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:14:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:14:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:14:36 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-01-15 15:14:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 15:15:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 15:15:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 15:15:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:15:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:15:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:15:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:15:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:15:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:15:36 [DEBUG   ] Finished updating board flags in 1.579 seconds
2019-01-15 15:15:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 15:16:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 15:16:05 [DEBUG   ] Got command RPT from MCS: ref #1176966
2019-01-15 15:16:05 [DEBUG   ] summary = ERROR
2019-01-15 15:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176966  13 58498 54965037 A  ERRORERROR'
2019-01-15 15:16:05 [DEBUG   ] Got command RPT from MCS: ref #1176967
2019-01-15 15:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176967  77 58498 54965038 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:16:22 [DEBUG   ] Got command RPT from MCS: ref #1176985
2019-01-15 15:16:22 [DEBUG   ] summary = ERROR
2019-01-15 15:16:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176985  13 58498 54982029 A  ERRORERROR'
2019-01-15 15:16:22 [DEBUG   ] Got command RPT from MCS: ref #1176986
2019-01-15 15:16:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:16:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176986  77 58498 54982233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:16:22 [DEBUG   ] Got command RPT from MCS: ref #1176987
2019-01-15 15:16:22 [DEBUG   ] summary = ERROR
2019-01-15 15:16:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176987  13 58498 54982437 A  ERRORERROR'
2019-01-15 15:16:22 [DEBUG   ] Got command RPT from MCS: ref #1176989
2019-01-15 15:16:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:16:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176989  77 58498 54982642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:16:22 [DEBUG   ] Got command RPT from MCS: ref #1176990
2019-01-15 15:16:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 15:16:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1176990  12 58498 54982833 A  ERRORB–™š'
2019-01-15 15:16:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 15:16:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:16:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:16:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:16:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:16:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:16:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:16:36 [DEBUG   ] Finished updating board flags in 1.425 seconds
2019-01-15 15:16:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 15:17:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 15:17:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 15:17:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:17:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:17:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:17:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:17:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:17:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:17:36 [DEBUG   ] Finished updating board flags in 1.386 seconds
2019-01-15 15:17:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 15:18:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 15:18:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 15:18:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:18:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:18:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:18:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:18:36 [WARNING ] (13, 1, 'bot')
2019-01-15 15:18:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:18:36 [DEBUG   ] Finished updating board flags in 1.437 seconds
2019-01-15 15:18:44 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 15:19:04 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 15:19:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 15:19:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:19:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 15:19:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:19:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:19:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:19:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:19:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:19:37 [DEBUG   ] Finished updating board flags in 2.196 seconds
2019-01-15 15:19:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 15:20:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 15:20:24 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 15:20:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:20:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:20:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:20:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:20:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:20:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:20:37 [DEBUG   ] Finished updating board flags in 1.958 seconds
2019-01-15 15:20:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 15:21:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 15:21:05 [DEBUG   ] Got command RPT from MCS: ref #1177003
2019-01-15 15:21:05 [DEBUG   ] summary = ERROR
2019-01-15 15:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177003  13 58498 55265041 A  ERRORERROR'
2019-01-15 15:21:05 [DEBUG   ] Got command RPT from MCS: ref #1177004
2019-01-15 15:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177004  77 58498 55265042 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:21:22 [DEBUG   ] Got command RPT from MCS: ref #1177020
2019-01-15 15:21:22 [DEBUG   ] summary = ERROR
2019-01-15 15:21:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177020  13 58498 55282117 A  ERRORERROR'
2019-01-15 15:21:22 [DEBUG   ] Got command RPT from MCS: ref #1177021
2019-01-15 15:21:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:21:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177021  77 58498 55282321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:21:22 [DEBUG   ] Got command RPT from MCS: ref #1177022
2019-01-15 15:21:22 [DEBUG   ] summary = ERROR
2019-01-15 15:21:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177022  13 58498 55282513 A  ERRORERROR'
2019-01-15 15:21:22 [DEBUG   ] Got command RPT from MCS: ref #1177023
2019-01-15 15:21:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:21:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177023  77 58498 55282717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:21:22 [DEBUG   ] Got command RPT from MCS: ref #1177024
2019-01-15 15:21:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 15:21:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177024  12 58498 55282921 A  ERRORB•™š'
2019-01-15 15:21:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 15:21:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:21:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:21:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:21:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:21:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:21:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:21:37 [DEBUG   ] Finished updating board flags in 1.824 seconds
2019-01-15 15:21:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 15:22:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 15:22:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 15:22:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:22:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:22:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:22:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:22:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:22:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:22:37 [DEBUG   ] Finished updating board flags in 1.782 seconds
2019-01-15 15:22:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 15:23:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 15:23:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 15:23:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:23:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:23:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:23:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:23:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:23:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:23:37 [DEBUG   ] Finished updating board flags in 1.639 seconds
2019-01-15 15:23:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 15:24:05 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-15 15:24:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 15:24:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 15:24:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:24:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:24:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:24:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:24:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:24:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:24:37 [DEBUG   ] Finished updating board flags in 1.576 seconds
2019-01-15 15:24:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 15:25:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 15:25:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 15:25:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:25:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:25:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:25:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:25:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:25:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:25:37 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-01-15 15:25:45 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 15:26:05 [DEBUG   ] Got command RPT from MCS: ref #1177029
2019-01-15 15:26:05 [DEBUG   ] summary = ERROR
2019-01-15 15:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177029  13 58498 55565041 A  ERRORERROR'
2019-01-15 15:26:05 [DEBUG   ] Got command RPT from MCS: ref #1177030
2019-01-15 15:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177030  77 58498 55565042 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:26:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 15:26:22 [DEBUG   ] Got command RPT from MCS: ref #1177048
2019-01-15 15:26:22 [DEBUG   ] summary = ERROR
2019-01-15 15:26:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177048  13 58498 55582201 A  ERRORERROR'
2019-01-15 15:26:22 [DEBUG   ] Got command RPT from MCS: ref #1177049
2019-01-15 15:26:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:26:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177049  77 58498 55582393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:26:22 [DEBUG   ] Got command RPT from MCS: ref #1177050
2019-01-15 15:26:22 [DEBUG   ] summary = ERROR
2019-01-15 15:26:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177050  13 58498 55582597 A  ERRORERROR'
2019-01-15 15:26:22 [DEBUG   ] Got command RPT from MCS: ref #1177052
2019-01-15 15:26:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:26:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177052  77 58498 55582801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:26:23 [DEBUG   ] Got command RPT from MCS: ref #1177053
2019-01-15 15:26:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 15:26:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177053  12 58498 55583005 A  ERRORB—™š'
2019-01-15 15:26:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 15:26:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:26:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:26:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:26:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:26:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:26:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:26:37 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-01-15 15:26:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 15:27:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 15:27:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 15:27:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:27:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:27:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:27:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:27:37 [WARNING ] (13, 1, 'bot')
2019-01-15 15:27:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:27:37 [DEBUG   ] Finished updating board flags in 1.382 seconds
2019-01-15 15:27:45 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-01-15 15:28:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 15:28:25 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 15:28:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:28:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:28:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:28:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:28:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:28:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:28:38 [DEBUG   ] Finished updating board flags in 2.030 seconds
2019-01-15 15:28:46 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 15:29:06 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 15:29:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 15:29:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:29:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:29:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:29:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:29:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:29:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:29:38 [DEBUG   ] Finished updating board flags in 2.006 seconds
2019-01-15 15:29:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 15:30:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 15:30:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 15:30:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:30:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 15:30:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:30:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:30:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:30:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:30:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:30:38 [DEBUG   ] Finished updating board flags in 1.995 seconds
2019-01-15 15:30:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 15:31:05 [DEBUG   ] Got command RPT from MCS: ref #1177066
2019-01-15 15:31:05 [DEBUG   ] summary = ERROR
2019-01-15 15:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177066  13 58498 55865041 A  ERRORERROR'
2019-01-15 15:31:05 [DEBUG   ] Got command RPT from MCS: ref #1177067
2019-01-15 15:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177067  77 58498 55865042 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:31:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 15:31:22 [DEBUG   ] Got command RPT from MCS: ref #1177083
2019-01-15 15:31:22 [DEBUG   ] summary = ERROR
2019-01-15 15:31:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177083  13 58498 55882273 A  ERRORERROR'
2019-01-15 15:31:22 [DEBUG   ] Got command RPT from MCS: ref #1177084
2019-01-15 15:31:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:31:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177084  77 58498 55882477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:31:22 [DEBUG   ] Got command RPT from MCS: ref #1177085
2019-01-15 15:31:22 [DEBUG   ] summary = ERROR
2019-01-15 15:31:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177085  13 58498 55882681 A  ERRORERROR'
2019-01-15 15:31:22 [DEBUG   ] Got command RPT from MCS: ref #1177086
2019-01-15 15:31:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:31:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177086  77 58498 55882885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:31:23 [DEBUG   ] Got command RPT from MCS: ref #1177087
2019-01-15 15:31:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 15:31:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177087  12 58498 55883077 A  ERRORB–™š'
2019-01-15 15:31:26 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 15:31:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:31:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:31:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:31:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:31:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:31:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:31:38 [DEBUG   ] Finished updating board flags in 1.802 seconds
2019-01-15 15:31:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 15:32:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 15:32:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 15:32:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:32:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:32:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:32:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:32:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:32:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:32:38 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-01-15 15:32:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 15:33:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 15:33:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 15:33:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:33:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:33:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:33:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:33:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:33:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:33:38 [DEBUG   ] Finished updating board flags in 1.791 seconds
2019-01-15 15:33:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 15:34:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 15:34:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 15:34:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:34:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:34:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:34:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:34:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:34:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:34:38 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-15 15:34:47 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 15:35:07 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 15:35:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 15:35:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:35:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 15:35:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:35:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:35:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:35:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:35:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:35:38 [DEBUG   ] Finished updating board flags in 1.596 seconds
2019-01-15 15:35:47 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 15:36:05 [DEBUG   ] Got command RPT from MCS: ref #1177096
2019-01-15 15:36:05 [DEBUG   ] summary = ERROR
2019-01-15 15:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177096  13 58498 56165045 A  ERRORERROR'
2019-01-15 15:36:05 [DEBUG   ] Got command RPT from MCS: ref #1177097
2019-01-15 15:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177097  77 58498 56165046 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:36:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 15:36:22 [DEBUG   ] Got command RPT from MCS: ref #1177115
2019-01-15 15:36:22 [DEBUG   ] summary = ERROR
2019-01-15 15:36:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177115  13 58498 56182361 A  ERRORERROR'
2019-01-15 15:36:22 [DEBUG   ] Got command RPT from MCS: ref #1177116
2019-01-15 15:36:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:36:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177116  77 58498 56182565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:36:22 [DEBUG   ] Got command RPT from MCS: ref #1177117
2019-01-15 15:36:22 [DEBUG   ] summary = ERROR
2019-01-15 15:36:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177117  13 58498 56182757 A  ERRORERROR'
2019-01-15 15:36:22 [DEBUG   ] Got command RPT from MCS: ref #1177119
2019-01-15 15:36:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:36:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177119  77 58498 56182961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:36:23 [DEBUG   ] Got command RPT from MCS: ref #1177120
2019-01-15 15:36:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 15:36:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177120  12 58498 56183165 A  ERRORB–™š'
2019-01-15 15:36:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 15:36:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:36:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 15:36:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:36:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:36:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:36:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:36:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:36:38 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-01-15 15:36:47 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-01-15 15:37:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 15:37:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 15:37:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 15:37:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:37:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:37:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:37:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:37:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:37:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:37:38 [DEBUG   ] Finished updating board flags in 1.398 seconds
2019-01-15 15:37:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 15:38:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 15:38:28 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 15:38:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:38:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:38:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:38:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:38:38 [WARNING ] (13, 1, 'bot')
2019-01-15 15:38:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:38:38 [DEBUG   ] Finished updating board flags in 1.364 seconds
2019-01-15 15:38:48 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 15:39:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 15:39:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 15:39:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:39:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:39:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:39:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:39:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:39:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:39:39 [DEBUG   ] Finished updating board flags in 2.058 seconds
2019-01-15 15:39:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 15:40:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 15:40:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 15:40:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:40:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:40:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:40:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:40:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:40:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:40:39 [DEBUG   ] Finished updating board flags in 1.984 seconds
2019-01-15 15:40:48 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 15:41:05 [DEBUG   ] Got command RPT from MCS: ref #1177129
2019-01-15 15:41:05 [DEBUG   ] summary = ERROR
2019-01-15 15:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177129  13 58498 56465041 A  ERRORERROR'
2019-01-15 15:41:05 [DEBUG   ] Got command RPT from MCS: ref #1177130
2019-01-15 15:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177130  77 58498 56465042 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:41:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 15:41:22 [DEBUG   ] Got command RPT from MCS: ref #1177146
2019-01-15 15:41:22 [DEBUG   ] summary = ERROR
2019-01-15 15:41:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177146  13 58498 56482441 A  ERRORERROR'
2019-01-15 15:41:22 [DEBUG   ] Got command RPT from MCS: ref #1177147
2019-01-15 15:41:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:41:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177147  77 58498 56482633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:41:22 [DEBUG   ] Got command RPT from MCS: ref #1177148
2019-01-15 15:41:22 [DEBUG   ] summary = ERROR
2019-01-15 15:41:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177148  13 58498 56482837 A  ERRORERROR'
2019-01-15 15:41:23 [DEBUG   ] Got command RPT from MCS: ref #1177149
2019-01-15 15:41:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:41:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177149  77 58498 56483041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:41:23 [DEBUG   ] Got command RPT from MCS: ref #1177150
2019-01-15 15:41:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 15:41:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177150  12 58498 56483245 A  ERRORB—™š'
2019-01-15 15:41:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 15:41:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:41:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:41:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:41:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:41:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:41:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:41:39 [DEBUG   ] Finished updating board flags in 1.824 seconds
2019-01-15 15:41:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 15:42:08 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 15:42:29 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 15:42:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:42:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 15:42:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:42:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:42:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:42:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:42:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:42:39 [DEBUG   ] Finished updating board flags in 1.783 seconds
2019-01-15 15:42:49 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 15:43:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 15:43:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 15:43:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:43:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:43:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:43:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:43:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:43:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:43:39 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-01-15 15:43:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 15:44:09 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 15:44:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 15:44:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:44:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:44:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:44:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:44:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:44:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:44:39 [DEBUG   ] Finished updating board flags in 1.581 seconds
2019-01-15 15:44:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 15:45:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 15:45:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 15:45:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:45:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:45:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:45:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:45:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:45:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:45:39 [DEBUG   ] Finished updating board flags in 1.481 seconds
2019-01-15 15:45:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 15:46:05 [DEBUG   ] Got command RPT from MCS: ref #1177159
2019-01-15 15:46:05 [DEBUG   ] summary = ERROR
2019-01-15 15:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177159  13 58498 56765045 A  ERRORERROR'
2019-01-15 15:46:05 [DEBUG   ] Got command RPT from MCS: ref #1177160
2019-01-15 15:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177160  77 58498 56765046 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:46:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 15:46:22 [DEBUG   ] Got command RPT from MCS: ref #1177178
2019-01-15 15:46:22 [DEBUG   ] summary = ERROR
2019-01-15 15:46:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177178  13 58498 56782521 A  ERRORERROR'
2019-01-15 15:46:22 [DEBUG   ] Got command RPT from MCS: ref #1177179
2019-01-15 15:46:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:46:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177179  77 58498 56782725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:46:22 [DEBUG   ] Got command RPT from MCS: ref #1177180
2019-01-15 15:46:22 [DEBUG   ] summary = ERROR
2019-01-15 15:46:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177180  13 58498 56782917 A  ERRORERROR'
2019-01-15 15:46:23 [DEBUG   ] Got command RPT from MCS: ref #1177182
2019-01-15 15:46:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:46:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177182  77 58498 56783121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:46:23 [DEBUG   ] Got command RPT from MCS: ref #1177183
2019-01-15 15:46:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 15:46:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177183  12 58498 56783325 A  ERRORB–™š'
2019-01-15 15:46:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 15:46:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:46:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:46:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:46:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:46:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:46:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:46:39 [DEBUG   ] Finished updating board flags in 1.443 seconds
2019-01-15 15:46:49 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 15:47:09 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 15:47:29 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 15:47:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:47:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:47:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:47:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:47:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:47:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:47:39 [DEBUG   ] Finished updating board flags in 1.451 seconds
2019-01-15 15:47:50 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-15 15:48:10 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 15:48:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 15:48:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:48:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:48:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:48:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:48:39 [WARNING ] (13, 1, 'bot')
2019-01-15 15:48:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:48:39 [DEBUG   ] Finished updating board flags in 1.445 seconds
2019-01-15 15:48:50 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-01-15 15:49:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 15:49:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 15:49:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:49:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 15:49:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:49:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:49:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:49:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:49:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:49:40 [DEBUG   ] Finished updating board flags in 2.268 seconds
2019-01-15 15:49:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 15:50:10 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 15:50:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 15:50:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:50:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:50:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:50:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:50:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:50:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:50:40 [DEBUG   ] Finished updating board flags in 2.129 seconds
2019-01-15 15:50:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 15:51:05 [DEBUG   ] Got command RPT from MCS: ref #1177196
2019-01-15 15:51:05 [DEBUG   ] summary = ERROR
2019-01-15 15:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177196  13 58498 57065041 A  ERRORERROR'
2019-01-15 15:51:05 [DEBUG   ] Got command RPT from MCS: ref #1177197
2019-01-15 15:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177197  77 58498 57065042 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:51:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 15:51:22 [DEBUG   ] Got command RPT from MCS: ref #1177213
2019-01-15 15:51:22 [DEBUG   ] summary = ERROR
2019-01-15 15:51:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177213  13 58498 57082597 A  ERRORERROR'
2019-01-15 15:51:22 [DEBUG   ] Got command RPT from MCS: ref #1177214
2019-01-15 15:51:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:51:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177214  77 58498 57082801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:51:23 [DEBUG   ] Got command RPT from MCS: ref #1177215
2019-01-15 15:51:23 [DEBUG   ] summary = ERROR
2019-01-15 15:51:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177215  13 58498 57083005 A  ERRORERROR'
2019-01-15 15:51:23 [DEBUG   ] Got command RPT from MCS: ref #1177216
2019-01-15 15:51:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:51:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177216  77 58498 57083197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:51:23 [DEBUG   ] Got command RPT from MCS: ref #1177217
2019-01-15 15:51:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 15:51:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177217  12 58498 57083401 A  ERRORB•™š'
2019-01-15 15:51:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 15:51:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:51:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:51:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:51:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:51:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:51:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:51:40 [DEBUG   ] Finished updating board flags in 2.003 seconds
2019-01-15 15:51:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 15:52:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 15:52:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 15:52:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:52:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:52:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:52:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:52:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:52:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:52:40 [DEBUG   ] Finished updating board flags in 2.013 seconds
2019-01-15 15:52:50 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 15:53:11 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 15:53:31 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 15:53:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-15 15:53:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:53:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:53:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:53:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:53:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:53:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:53:40 [DEBUG   ] Finished updating board flags in 1.993 seconds
2019-01-15 15:53:51 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 15:54:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 15:54:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 15:54:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:54:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:54:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:54:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:54:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:54:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:54:40 [DEBUG   ] Finished updating board flags in 1.803 seconds
2019-01-15 15:54:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 15:55:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 15:55:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 15:55:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:55:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:55:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:55:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:55:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:55:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:55:40 [DEBUG   ] Finished updating board flags in 1.799 seconds
2019-01-15 15:55:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 15:56:05 [DEBUG   ] Got command RPT from MCS: ref #1177222
2019-01-15 15:56:05 [DEBUG   ] summary = ERROR
2019-01-15 15:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177222  13 58498 57365045 A  ERRORERROR'
2019-01-15 15:56:05 [DEBUG   ] Got command RPT from MCS: ref #1177223
2019-01-15 15:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177223  77 58498 57365046 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:56:11 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 15:56:22 [DEBUG   ] Got command RPT from MCS: ref #1177241
2019-01-15 15:56:22 [DEBUG   ] summary = ERROR
2019-01-15 15:56:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177241  13 58498 57382677 A  ERRORERROR'
2019-01-15 15:56:22 [DEBUG   ] Got command RPT from MCS: ref #1177242
2019-01-15 15:56:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:56:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177242  77 58498 57382881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:56:23 [DEBUG   ] Got command RPT from MCS: ref #1177243
2019-01-15 15:56:23 [DEBUG   ] summary = ERROR
2019-01-15 15:56:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177243  13 58498 57383085 A  ERRORERROR'
2019-01-15 15:56:23 [DEBUG   ] Got command RPT from MCS: ref #1177245
2019-01-15 15:56:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 15:56:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177245  77 58498 57383289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 15:56:23 [DEBUG   ] Got command RPT from MCS: ref #1177246
2019-01-15 15:56:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 15:56:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177246  12 58498 57383481 A  ERRORB–™š'
2019-01-15 15:56:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 15:56:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 15:56:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:56:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:56:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:56:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:56:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:56:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:56:40 [DEBUG   ] Finished updating board flags in 1.659 seconds
2019-01-15 15:56:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 15:57:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 15:57:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 15:57:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:57:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:57:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:57:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:57:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:57:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:57:40 [DEBUG   ] Finished updating board flags in 1.564 seconds
2019-01-15 15:57:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 15:58:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 15:58:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 15:58:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 15:58:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:58:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 15:58:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:58:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:58:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:58:40 [WARNING ] (13, 1, 'bot')
2019-01-15 15:58:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:58:40 [DEBUG   ] Finished updating board flags in 1.399 seconds
2019-01-15 15:58:52 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 15:59:12 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 15:59:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 15:59:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 15:59:41 [WARNING ] (13, 1, 'bot')
2019-01-15 15:59:41 [WARNING ] (13, 1, 'bot')
2019-01-15 15:59:41 [WARNING ] (13, 1, 'bot')
2019-01-15 15:59:41 [WARNING ] (13, 1, 'bot')
2019-01-15 15:59:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 15:59:41 [DEBUG   ] Finished updating board flags in 2.208 seconds
2019-01-15 15:59:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 16:00:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 16:00:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 16:00:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:00:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:00:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:00:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:00:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:00:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:00:41 [DEBUG   ] Finished updating board flags in 2.186 seconds
2019-01-15 16:00:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 16:01:05 [DEBUG   ] Got command RPT from MCS: ref #1177259
2019-01-15 16:01:05 [DEBUG   ] summary = ERROR
2019-01-15 16:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177259  13 58498 57665041 A  ERRORERROR'
2019-01-15 16:01:05 [DEBUG   ] Got command RPT from MCS: ref #1177260
2019-01-15 16:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177260  77 58498 57665042 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:01:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 16:01:22 [DEBUG   ] Got command RPT from MCS: ref #1177276
2019-01-15 16:01:22 [DEBUG   ] summary = ERROR
2019-01-15 16:01:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177276  13 58498 57682765 A  ERRORERROR'
2019-01-15 16:01:22 [DEBUG   ] Got command RPT from MCS: ref #1177277
2019-01-15 16:01:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:01:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177277  77 58498 57682969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:01:23 [DEBUG   ] Got command RPT from MCS: ref #1177278
2019-01-15 16:01:23 [DEBUG   ] summary = ERROR
2019-01-15 16:01:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177278  13 58498 57683161 A  ERRORERROR'
2019-01-15 16:01:23 [DEBUG   ] Got command RPT from MCS: ref #1177279
2019-01-15 16:01:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:01:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177279  77 58498 57683365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:01:23 [DEBUG   ] Got command RPT from MCS: ref #1177280
2019-01-15 16:01:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 16:01:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177280  12 58498 57683569 A  ERRORB–™š'
2019-01-15 16:01:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 16:01:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:01:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 16:01:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:01:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:01:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:01:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:01:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:01:41 [DEBUG   ] Finished updating board flags in 2.030 seconds
2019-01-15 16:01:52 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 16:02:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 16:02:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 16:02:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:02:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 16:02:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:02:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:02:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:02:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:02:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:02:41 [DEBUG   ] Finished updating board flags in 1.974 seconds
2019-01-15 16:02:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 16:03:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 16:03:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 16:03:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:03:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 16:03:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 16:03:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:03:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:03:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:03:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:03:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:03:41 [DEBUG   ] Finished updating board flags in 1.820 seconds
2019-01-15 16:03:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 16:04:12 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 16:04:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 16:04:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:04:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:04:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:04:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:04:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:04:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:04:41 [DEBUG   ] Finished updating board flags in 1.786 seconds
2019-01-15 16:04:52 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 16:05:13 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 16:05:33 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 16:05:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:05:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 16:05:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:05:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:05:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:05:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:05:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:05:41 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-01-15 16:05:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 16:06:05 [DEBUG   ] Got command RPT from MCS: ref #1177289
2019-01-15 16:06:05 [DEBUG   ] summary = ERROR
2019-01-15 16:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177289  13 58498 57965049 A  ERRORERROR'
2019-01-15 16:06:05 [DEBUG   ] Got command RPT from MCS: ref #1177290
2019-01-15 16:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177290  77 58498 57965050 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:06:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 16:06:22 [DEBUG   ] Got command RPT from MCS: ref #1177308
2019-01-15 16:06:22 [DEBUG   ] summary = ERROR
2019-01-15 16:06:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177308  13 58498 57982845 A  ERRORERROR'
2019-01-15 16:06:23 [DEBUG   ] Got command RPT from MCS: ref #1177309
2019-01-15 16:06:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:06:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177309  77 58498 57983049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:06:23 [DEBUG   ] Got command RPT from MCS: ref #1177310
2019-01-15 16:06:23 [DEBUG   ] summary = ERROR
2019-01-15 16:06:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177310  13 58498 57983241 A  ERRORERROR'
2019-01-15 16:06:23 [DEBUG   ] Got command RPT from MCS: ref #1177312
2019-01-15 16:06:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:06:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177312  77 58498 57983445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:06:23 [DEBUG   ] Got command RPT from MCS: ref #1177313
2019-01-15 16:06:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 16:06:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177313  12 58498 57983649 A  ERRORB•™š'
2019-01-15 16:06:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 16:06:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:06:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:06:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:06:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:06:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:06:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:06:41 [DEBUG   ] Finished updating board flags in 1.582 seconds
2019-01-15 16:06:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 16:07:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 16:07:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 16:07:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:07:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:07:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:07:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:07:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:07:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:07:41 [DEBUG   ] Finished updating board flags in 1.419 seconds
2019-01-15 16:07:53 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 16:08:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 16:08:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 16:08:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:08:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:08:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:08:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:08:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:08:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:08:41 [DEBUG   ] Finished updating board flags in 1.393 seconds
2019-01-15 16:08:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 16:09:13 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 16:09:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 16:09:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:09:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:09:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:09:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:09:41 [WARNING ] (13, 1, 'bot')
2019-01-15 16:09:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:09:41 [DEBUG   ] Finished updating board flags in 1.389 seconds
2019-01-15 16:09:53 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 16:10:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 16:10:33 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 16:10:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:10:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:10:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:10:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:10:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:10:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:10:42 [DEBUG   ] Finished updating board flags in 2.077 seconds
2019-01-15 16:10:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 16:11:05 [DEBUG   ] Got command RPT from MCS: ref #1177322
2019-01-15 16:11:05 [DEBUG   ] summary = ERROR
2019-01-15 16:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177322  13 58498 58265049 A  ERRORERROR'
2019-01-15 16:11:05 [DEBUG   ] Got command RPT from MCS: ref #1177323
2019-01-15 16:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177323  77 58498 58265050 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:11:14 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 16:11:22 [DEBUG   ] Got command RPT from MCS: ref #1177339
2019-01-15 16:11:22 [DEBUG   ] summary = ERROR
2019-01-15 16:11:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177339  13 58498 58282921 A  ERRORERROR'
2019-01-15 16:11:23 [DEBUG   ] Got command RPT from MCS: ref #1177340
2019-01-15 16:11:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:11:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177340  77 58498 58283125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:11:23 [DEBUG   ] Got command RPT from MCS: ref #1177341
2019-01-15 16:11:23 [DEBUG   ] summary = ERROR
2019-01-15 16:11:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177341  13 58498 58283329 A  ERRORERROR'
2019-01-15 16:11:23 [DEBUG   ] Got command RPT from MCS: ref #1177342
2019-01-15 16:11:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:11:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177342  77 58498 58283521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:11:23 [DEBUG   ] Got command RPT from MCS: ref #1177343
2019-01-15 16:11:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 16:11:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177343  12 58498 58283725 A  ERRORB—™š'
2019-01-15 16:11:34 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 16:11:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:11:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:11:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:11:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:11:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:11:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:11:42 [DEBUG   ] Finished updating board flags in 1.929 seconds
2019-01-15 16:11:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 16:12:14 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 16:12:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 16:12:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:12:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:12:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:12:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:12:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:12:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:12:42 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-15 16:12:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 16:13:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 16:13:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 16:13:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:13:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:13:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:13:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:13:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:13:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:13:42 [DEBUG   ] Finished updating board flags in 1.803 seconds
2019-01-15 16:13:54 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 16:14:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 16:14:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 16:14:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:14:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:14:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:14:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:14:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:14:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:14:42 [DEBUG   ] Finished updating board flags in 1.797 seconds
2019-01-15 16:14:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 16:15:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 16:15:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 16:15:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:15:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:15:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:15:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:15:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:15:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:15:42 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-15 16:15:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 16:16:05 [DEBUG   ] Got command RPT from MCS: ref #1177352
2019-01-15 16:16:05 [DEBUG   ] summary = ERROR
2019-01-15 16:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177352  13 58498 58565045 A  ERRORERROR'
2019-01-15 16:16:05 [DEBUG   ] Got command RPT from MCS: ref #1177353
2019-01-15 16:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177353  77 58498 58565046 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:16:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 16:16:23 [DEBUG   ] Got command RPT from MCS: ref #1177371
2019-01-15 16:16:23 [DEBUG   ] summary = ERROR
2019-01-15 16:16:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177371  13 58498 58583009 A  ERRORERROR'
2019-01-15 16:16:23 [DEBUG   ] Got command RPT from MCS: ref #1177372
2019-01-15 16:16:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:16:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177372  77 58498 58583213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:16:23 [DEBUG   ] Got command RPT from MCS: ref #1177373
2019-01-15 16:16:23 [DEBUG   ] summary = ERROR
2019-01-15 16:16:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177373  13 58498 58583405 A  ERRORERROR'
2019-01-15 16:16:23 [DEBUG   ] Got command RPT from MCS: ref #1177375
2019-01-15 16:16:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:16:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177375  77 58498 58583609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:16:23 [DEBUG   ] Got command RPT from MCS: ref #1177377
2019-01-15 16:16:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 16:16:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177377  12 58498 58583813 A  ERRORB–™š'
2019-01-15 16:16:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 16:16:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:16:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 16:16:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:16:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:16:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:16:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:16:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:16:42 [DEBUG   ] Finished updating board flags in 1.603 seconds
2019-01-15 16:16:55 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 16:17:15 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 16:17:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 16:17:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:17:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:17:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:17:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:17:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:17:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:17:42 [DEBUG   ] Finished updating board flags in 1.604 seconds
2019-01-15 16:17:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 16:18:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 16:18:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 16:18:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:18:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:18:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:18:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:18:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:18:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:18:42 [DEBUG   ] Finished updating board flags in 1.602 seconds
2019-01-15 16:18:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 16:19:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 16:19:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 16:19:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:19:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:19:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:19:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:19:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:19:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:19:42 [DEBUG   ] Finished updating board flags in 1.601 seconds
2019-01-15 16:19:55 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 16:20:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 16:20:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 16:20:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:20:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 16:20:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:20:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:20:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:20:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:20:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:20:42 [DEBUG   ] Finished updating board flags in 1.598 seconds
2019-01-15 16:20:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 16:21:05 [DEBUG   ] Got command RPT from MCS: ref #1177389
2019-01-15 16:21:05 [DEBUG   ] summary = ERROR
2019-01-15 16:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177389  13 58498 58865045 A  ERRORERROR'
2019-01-15 16:21:05 [DEBUG   ] Got command RPT from MCS: ref #1177390
2019-01-15 16:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177390  77 58498 58865046 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:21:16 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 16:21:23 [DEBUG   ] Got command RPT from MCS: ref #1177406
2019-01-15 16:21:23 [DEBUG   ] summary = ERROR
2019-01-15 16:21:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177406  13 58498 58883085 A  ERRORERROR'
2019-01-15 16:21:23 [DEBUG   ] Got command RPT from MCS: ref #1177407
2019-01-15 16:21:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:21:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177407  77 58498 58883289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:21:23 [DEBUG   ] Got command RPT from MCS: ref #1177408
2019-01-15 16:21:23 [DEBUG   ] summary = ERROR
2019-01-15 16:21:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177408  13 58498 58883493 A  ERRORERROR'
2019-01-15 16:21:23 [DEBUG   ] Got command RPT from MCS: ref #1177409
2019-01-15 16:21:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:21:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177409  77 58498 58883685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:21:23 [DEBUG   ] Got command RPT from MCS: ref #1177410
2019-01-15 16:21:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 16:21:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177410  12 58498 58883889 A  ERRORB•™š'
2019-01-15 16:21:36 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 16:21:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:21:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:21:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:21:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:21:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:21:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:21:42 [DEBUG   ] Finished updating board flags in 1.406 seconds
2019-01-15 16:21:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 16:22:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 16:22:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 16:22:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:22:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:22:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:22:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:22:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:22:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:22:42 [DEBUG   ] Finished updating board flags in 1.419 seconds
2019-01-15 16:22:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 16:23:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 16:23:36 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 16:23:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:23:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:23:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:23:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:23:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:23:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:23:42 [DEBUG   ] Finished updating board flags in 1.380 seconds
2019-01-15 16:23:56 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 16:24:17 [DEBUG   ] Finished updating ant stats in 1.804 seconds
2019-01-15 16:24:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 16:24:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:24:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:24:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:24:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:24:42 [WARNING ] (13, 1, 'bot')
2019-01-15 16:24:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:24:42 [DEBUG   ] Finished updating board flags in 1.357 seconds
2019-01-15 16:24:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 16:25:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 16:25:37 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2019-01-15 16:25:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:25:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:25:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:25:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:25:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:25:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:25:43 [DEBUG   ] Finished updating board flags in 2.062 seconds
2019-01-15 16:25:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 16:26:05 [DEBUG   ] Got command RPT from MCS: ref #1177415
2019-01-15 16:26:05 [DEBUG   ] summary = ERROR
2019-01-15 16:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177415  13 58498 59165045 A  ERRORERROR'
2019-01-15 16:26:05 [DEBUG   ] Got command RPT from MCS: ref #1177416
2019-01-15 16:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177416  77 58498 59165046 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:26:16 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 16:26:23 [DEBUG   ] Got command RPT from MCS: ref #1177434
2019-01-15 16:26:23 [DEBUG   ] summary = ERROR
2019-01-15 16:26:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177434  13 58498 59183165 A  ERRORERROR'
2019-01-15 16:26:23 [DEBUG   ] Got command RPT from MCS: ref #1177435
2019-01-15 16:26:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:26:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177435  77 58498 59183369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:26:23 [DEBUG   ] Got command RPT from MCS: ref #1177436
2019-01-15 16:26:23 [DEBUG   ] summary = ERROR
2019-01-15 16:26:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177436  13 58498 59183573 A  ERRORERROR'
2019-01-15 16:26:23 [DEBUG   ] Got command RPT from MCS: ref #1177438
2019-01-15 16:26:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:26:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177438  77 58498 59183765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:26:23 [DEBUG   ] Got command RPT from MCS: ref #1177439
2019-01-15 16:26:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 16:26:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177439  12 58498 59183969 A  ERRORB—™š'
2019-01-15 16:26:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 16:26:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 16:26:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:26:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-15 16:26:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:26:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:26:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:26:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:26:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:26:43 [DEBUG   ] Finished updating board flags in 2.106 seconds
2019-01-15 16:26:57 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 16:27:17 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 16:27:37 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 16:27:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:27:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:27:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:27:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:27:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:27:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:27:43 [DEBUG   ] Finished updating board flags in 1.897 seconds
2019-01-15 16:27:57 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 16:28:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 16:28:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 16:28:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:28:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-15 16:28:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:28:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:28:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:28:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:28:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:28:43 [DEBUG   ] Finished updating board flags in 1.820 seconds
2019-01-15 16:28:57 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 16:29:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 16:29:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 16:29:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:29:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:29:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:29:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:29:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:29:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:29:43 [DEBUG   ] Finished updating board flags in 1.782 seconds
2019-01-15 16:29:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 16:30:17 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 16:30:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 16:30:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:30:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:30:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:30:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:30:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:30:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:30:43 [DEBUG   ] Finished updating board flags in 1.603 seconds
2019-01-15 16:30:58 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 16:31:05 [DEBUG   ] Got command RPT from MCS: ref #1177452
2019-01-15 16:31:05 [DEBUG   ] summary = ERROR
2019-01-15 16:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177452  13 58498 59465057 A  ERRORERROR'
2019-01-15 16:31:05 [DEBUG   ] Got command RPT from MCS: ref #1177453
2019-01-15 16:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177453  77 58498 59465058 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:31:18 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 16:31:23 [DEBUG   ] Got command RPT from MCS: ref #1177469
2019-01-15 16:31:23 [DEBUG   ] summary = ERROR
2019-01-15 16:31:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177469  13 58498 59483245 A  ERRORERROR'
2019-01-15 16:31:23 [DEBUG   ] Got command RPT from MCS: ref #1177470
2019-01-15 16:31:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:31:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177470  77 58498 59483449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:31:23 [DEBUG   ] Got command RPT from MCS: ref #1177471
2019-01-15 16:31:23 [DEBUG   ] summary = ERROR
2019-01-15 16:31:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177471  13 58498 59483653 A  ERRORERROR'
2019-01-15 16:31:23 [DEBUG   ] Got command RPT from MCS: ref #1177472
2019-01-15 16:31:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:31:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177472  77 58498 59483845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:31:24 [DEBUG   ] Got command RPT from MCS: ref #1177473
2019-01-15 16:31:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 16:31:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177473  12 58498 59484049 A  ERRORB—™š'
2019-01-15 16:31:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 16:31:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:31:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:31:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:31:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:31:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:31:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:31:43 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-01-15 16:31:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 16:32:18 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 16:32:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 16:32:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:32:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:32:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:32:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:32:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:32:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:32:43 [DEBUG   ] Finished updating board flags in 1.584 seconds
2019-01-15 16:32:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 16:33:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 16:33:38 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 16:33:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:33:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 16:33:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 16:33:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:33:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:33:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:33:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:33:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:33:43 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-01-15 16:33:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 16:34:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 16:34:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 16:34:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:34:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 16:34:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:34:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:34:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:34:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:34:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:34:43 [DEBUG   ] Finished updating board flags in 1.384 seconds
2019-01-15 16:34:58 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-01-15 16:35:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 16:35:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 16:35:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:35:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:35:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:35:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:35:43 [WARNING ] (13, 1, 'bot')
2019-01-15 16:35:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:35:43 [DEBUG   ] Finished updating board flags in 1.364 seconds
2019-01-15 16:35:58 [DEBUG   ] Finished updating ant stats in 0.476 seconds
2019-01-15 16:36:05 [DEBUG   ] Got command RPT from MCS: ref #1177482
2019-01-15 16:36:05 [DEBUG   ] summary = ERROR
2019-01-15 16:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177482  13 58498 59765050 A  ERRORERROR'
2019-01-15 16:36:05 [DEBUG   ] Got command RPT from MCS: ref #1177483
2019-01-15 16:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177483  77 58498 59765050 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:36:18 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-15 16:36:23 [DEBUG   ] Got command RPT from MCS: ref #1177501
2019-01-15 16:36:23 [DEBUG   ] summary = ERROR
2019-01-15 16:36:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177501  13 58498 59783326 A  ERRORERROR'
2019-01-15 16:36:23 [DEBUG   ] Got command RPT from MCS: ref #1177502
2019-01-15 16:36:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:36:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177502  77 58498 59783529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:36:23 [DEBUG   ] Got command RPT from MCS: ref #1177503
2019-01-15 16:36:23 [DEBUG   ] summary = ERROR
2019-01-15 16:36:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177503  13 58498 59783733 A  ERRORERROR'
2019-01-15 16:36:23 [DEBUG   ] Got command RPT from MCS: ref #1177505
2019-01-15 16:36:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:36:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177505  77 58498 59783926 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:36:24 [DEBUG   ] Got command RPT from MCS: ref #1177507
2019-01-15 16:36:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 16:36:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177507  12 58498 59784129 A  ERRORB–™š'
2019-01-15 16:36:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 16:36:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:36:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:36:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:36:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:36:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:36:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:36:44 [DEBUG   ] Finished updating board flags in 2.054 seconds
2019-01-15 16:36:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 16:37:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 16:37:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 16:37:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:37:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:37:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:37:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:37:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:37:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:37:44 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-01-15 16:37:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 16:38:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 16:38:39 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 16:38:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:38:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:38:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:38:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:38:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:38:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:38:44 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-01-15 16:38:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 16:39:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 16:39:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 16:39:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:39:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 16:39:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:39:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:39:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:39:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:39:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:39:44 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-15 16:39:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 16:40:19 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 16:40:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 16:40:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:40:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:40:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:40:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:40:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:40:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:40:44 [DEBUG   ] Finished updating board flags in 1.794 seconds
2019-01-15 16:41:00 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 16:41:05 [DEBUG   ] Got command RPT from MCS: ref #1177515
2019-01-15 16:41:05 [DEBUG   ] summary = ERROR
2019-01-15 16:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177515  13 58498 60065049 A  ERRORERROR'
2019-01-15 16:41:05 [DEBUG   ] Got command RPT from MCS: ref #1177516
2019-01-15 16:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177516  77 58498 60065050 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:41:20 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 16:41:23 [DEBUG   ] Got command RPT from MCS: ref #1177532
2019-01-15 16:41:23 [DEBUG   ] summary = ERROR
2019-01-15 16:41:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177532  13 58498 60083405 A  ERRORERROR'
2019-01-15 16:41:23 [DEBUG   ] Got command RPT from MCS: ref #1177533
2019-01-15 16:41:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:41:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177533  77 58498 60083609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:41:23 [DEBUG   ] Got command RPT from MCS: ref #1177534
2019-01-15 16:41:23 [DEBUG   ] summary = ERROR
2019-01-15 16:41:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177534  13 58498 60083813 A  ERRORERROR'
2019-01-15 16:41:24 [DEBUG   ] Got command RPT from MCS: ref #1177535
2019-01-15 16:41:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:41:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177535  77 58498 60084017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:41:24 [DEBUG   ] Got command RPT from MCS: ref #1177536
2019-01-15 16:41:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 16:41:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177536  12 58498 60084209 A  ERRORB•™š'
2019-01-15 16:41:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 16:41:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:41:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 16:41:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:41:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:41:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:41:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:41:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:41:44 [DEBUG   ] Finished updating board flags in 1.609 seconds
2019-01-15 16:42:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 16:42:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 16:42:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 16:42:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:42:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:42:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:42:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:42:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:42:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:42:44 [DEBUG   ] Finished updating board flags in 1.587 seconds
2019-01-15 16:43:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 16:43:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 16:43:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 16:43:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 16:43:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:43:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 16:43:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:43:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:43:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:43:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:43:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:43:44 [DEBUG   ] Finished updating board flags in 1.419 seconds
2019-01-15 16:44:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 16:44:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 16:44:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 16:44:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 16:44:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:44:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:44:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:44:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:44:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:44:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:44:44 [DEBUG   ] Finished updating board flags in 1.389 seconds
2019-01-15 16:45:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 16:45:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 16:45:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 16:45:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:45:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:45:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:45:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:45:44 [WARNING ] (13, 1, 'bot')
2019-01-15 16:45:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:45:44 [DEBUG   ] Finished updating board flags in 1.360 seconds
2019-01-15 16:46:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 16:46:05 [DEBUG   ] Got command RPT from MCS: ref #1177545
2019-01-15 16:46:05 [DEBUG   ] summary = ERROR
2019-01-15 16:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177545  13 58498 60365053 A  ERRORERROR'
2019-01-15 16:46:05 [DEBUG   ] Got command RPT from MCS: ref #1177546
2019-01-15 16:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177546  77 58498 60365054 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:46:20 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 16:46:23 [DEBUG   ] Got command RPT from MCS: ref #1177564
2019-01-15 16:46:23 [DEBUG   ] summary = ERROR
2019-01-15 16:46:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177564  13 58498 60383485 A  ERRORERROR'
2019-01-15 16:46:23 [DEBUG   ] Got command RPT from MCS: ref #1177565
2019-01-15 16:46:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:46:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177565  77 58498 60383689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:46:23 [DEBUG   ] Got command RPT from MCS: ref #1177566
2019-01-15 16:46:23 [DEBUG   ] summary = ERROR
2019-01-15 16:46:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177566  13 58498 60383893 A  ERRORERROR'
2019-01-15 16:46:24 [DEBUG   ] Got command RPT from MCS: ref #1177568
2019-01-15 16:46:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:46:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177568  77 58498 60384097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:46:24 [DEBUG   ] Got command RPT from MCS: ref #1177569
2019-01-15 16:46:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 16:46:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177569  12 58498 60384289 A  ERRORB—™š'
2019-01-15 16:46:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 16:46:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:46:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:46:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:46:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:46:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:46:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:46:45 [DEBUG   ] Finished updating board flags in 2.061 seconds
2019-01-15 16:47:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 16:47:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 16:47:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 16:47:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:47:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:47:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:47:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:47:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:47:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:47:45 [DEBUG   ] Finished updating board flags in 2.043 seconds
2019-01-15 16:48:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 16:48:21 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 16:48:41 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 16:48:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:48:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:48:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:48:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:48:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:48:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:48:45 [DEBUG   ] Finished updating board flags in 1.953 seconds
2019-01-15 16:49:01 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 16:49:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 16:49:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 16:49:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:49:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:49:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:49:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:49:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:49:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:49:45 [DEBUG   ] Finished updating board flags in 1.802 seconds
2019-01-15 16:50:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 16:50:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 16:50:42 [DEBUG   ] Finished updating ant stats in 1.802 seconds
2019-01-15 16:50:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:50:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 16:50:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:50:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:50:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:50:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:50:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:50:45 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-01-15 16:51:01 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2019-01-15 16:51:05 [DEBUG   ] Got command RPT from MCS: ref #1177582
2019-01-15 16:51:05 [DEBUG   ] summary = ERROR
2019-01-15 16:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177582  13 58498 60665057 A  ERRORERROR'
2019-01-15 16:51:05 [DEBUG   ] Got command RPT from MCS: ref #1177583
2019-01-15 16:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177583  77 58498 60665058 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:51:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 16:51:23 [DEBUG   ] Got command RPT from MCS: ref #1177599
2019-01-15 16:51:23 [DEBUG   ] summary = ERROR
2019-01-15 16:51:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177599  13 58498 60683573 A  ERRORERROR'
2019-01-15 16:51:23 [DEBUG   ] Got command RPT from MCS: ref #1177600
2019-01-15 16:51:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:51:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177600  77 58498 60683777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:51:23 [DEBUG   ] Got command RPT from MCS: ref #1177601
2019-01-15 16:51:23 [DEBUG   ] summary = ERROR
2019-01-15 16:51:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177601  13 58498 60683969 A  ERRORERROR'
2019-01-15 16:51:24 [DEBUG   ] Got command RPT from MCS: ref #1177602
2019-01-15 16:51:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:51:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177602  77 58498 60684173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:51:24 [DEBUG   ] Got command RPT from MCS: ref #1177603
2019-01-15 16:51:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 16:51:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177603  12 58498 60684377 A  ERRORB–™š'
2019-01-15 16:51:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 16:51:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:51:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:51:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:51:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:51:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:51:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:51:45 [DEBUG   ] Finished updating board flags in 1.799 seconds
2019-01-15 16:52:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 16:52:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 16:52:42 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-15 16:52:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:52:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:52:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:52:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:52:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:52:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:52:45 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-15 16:53:02 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 16:53:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 16:53:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 16:53:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:53:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 16:53:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:53:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:53:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:53:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:53:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:53:45 [DEBUG   ] Finished updating board flags in 1.574 seconds
2019-01-15 16:54:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 16:54:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 16:54:42 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 16:54:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:54:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:54:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:54:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:54:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:54:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:54:45 [DEBUG   ] Finished updating board flags in 1.434 seconds
2019-01-15 16:55:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 16:55:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 16:55:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 16:55:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:55:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:55:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:55:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:55:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:55:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:55:45 [DEBUG   ] Finished updating board flags in 1.424 seconds
2019-01-15 16:56:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 16:56:05 [DEBUG   ] Got command RPT from MCS: ref #1177608
2019-01-15 16:56:05 [DEBUG   ] summary = ERROR
2019-01-15 16:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177608  13 58498 60965053 A  ERRORERROR'
2019-01-15 16:56:05 [DEBUG   ] Got command RPT from MCS: ref #1177609
2019-01-15 16:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177609  77 58498 60965054 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:56:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 16:56:23 [DEBUG   ] Got command RPT from MCS: ref #1177627
2019-01-15 16:56:23 [DEBUG   ] summary = ERROR
2019-01-15 16:56:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177627  13 58498 60983645 A  ERRORERROR'
2019-01-15 16:56:23 [DEBUG   ] Got command RPT from MCS: ref #1177628
2019-01-15 16:56:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:56:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177628  77 58498 60983849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:56:24 [DEBUG   ] Got command RPT from MCS: ref #1177629
2019-01-15 16:56:24 [DEBUG   ] summary = ERROR
2019-01-15 16:56:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177629  13 58498 60984053 A  ERRORERROR'
2019-01-15 16:56:24 [DEBUG   ] Got command RPT from MCS: ref #1177631
2019-01-15 16:56:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 16:56:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177631  77 58498 60984257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 16:56:24 [DEBUG   ] Got command RPT from MCS: ref #1177632
2019-01-15 16:56:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 16:56:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177632  12 58498 60984449 A  ERRORB•™š'
2019-01-15 16:56:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 16:56:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:56:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:56:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:56:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:56:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:56:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:56:45 [DEBUG   ] Finished updating board flags in 1.422 seconds
2019-01-15 16:57:02 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 16:57:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 16:57:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 16:57:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:57:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:57:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:57:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:57:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:57:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:57:45 [DEBUG   ] Finished updating board flags in 1.425 seconds
2019-01-15 16:58:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 16:58:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 16:58:42 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 16:58:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:58:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:58:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:58:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:58:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:58:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:58:45 [DEBUG   ] Finished updating board flags in 1.488 seconds
2019-01-15 16:59:03 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 16:59:23 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 16:59:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 16:59:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 16:59:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 16:59:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:59:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:59:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:59:45 [WARNING ] (13, 1, 'bot')
2019-01-15 16:59:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 16:59:45 [DEBUG   ] Finished updating board flags in 1.501 seconds
2019-01-15 17:00:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 17:00:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 17:00:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 17:00:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:00:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:00:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:00:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:00:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:00:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:00:46 [DEBUG   ] Finished updating board flags in 2.183 seconds
2019-01-15 17:01:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 17:01:05 [DEBUG   ] Got command RPT from MCS: ref #1177645
2019-01-15 17:01:05 [DEBUG   ] summary = ERROR
2019-01-15 17:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177645  13 58498 61265057 A  ERRORERROR'
2019-01-15 17:01:05 [DEBUG   ] Got command RPT from MCS: ref #1177646
2019-01-15 17:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177646  77 58498 61265058 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:01:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 17:01:23 [DEBUG   ] Got command RPT from MCS: ref #1177662
2019-01-15 17:01:23 [DEBUG   ] summary = ERROR
2019-01-15 17:01:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177662  13 58498 61283725 A  ERRORERROR'
2019-01-15 17:01:23 [DEBUG   ] Got command RPT from MCS: ref #1177663
2019-01-15 17:01:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:01:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177663  77 58498 61283929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:01:24 [DEBUG   ] Got command RPT from MCS: ref #1177664
2019-01-15 17:01:24 [DEBUG   ] summary = ERROR
2019-01-15 17:01:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177664  13 58498 61284133 A  ERRORERROR'
2019-01-15 17:01:24 [DEBUG   ] Got command RPT from MCS: ref #1177665
2019-01-15 17:01:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:01:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177665  77 58498 61284325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:01:24 [DEBUG   ] Got command RPT from MCS: ref #1177666
2019-01-15 17:01:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 17:01:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177666  12 58498 61284529 A  ERRORB–™š'
2019-01-15 17:01:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 17:01:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:01:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:01:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:01:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:01:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:01:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:01:46 [DEBUG   ] Finished updating board flags in 1.919 seconds
2019-01-15 17:02:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 17:02:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 17:02:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 17:02:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 17:02:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:02:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 17:02:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-15 17:02:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:02:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:02:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:02:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:02:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:02:46 [DEBUG   ] Finished updating board flags in 1.823 seconds
2019-01-15 17:03:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 17:03:23 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 17:03:43 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 17:03:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 17:03:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:03:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:03:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:03:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:03:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:03:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:03:46 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-01-15 17:04:04 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 17:04:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 17:04:44 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 17:04:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:04:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:04:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:04:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:04:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:04:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:04:46 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-15 17:05:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 17:05:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 17:05:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 17:05:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:05:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:05:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:05:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:05:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:05:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:05:46 [DEBUG   ] Finished updating board flags in 1.610 seconds
2019-01-15 17:06:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 17:06:05 [DEBUG   ] Got command RPT from MCS: ref #1177675
2019-01-15 17:06:05 [DEBUG   ] summary = ERROR
2019-01-15 17:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177675  13 58498 61565053 A  ERRORERROR'
2019-01-15 17:06:05 [DEBUG   ] Got command RPT from MCS: ref #1177676
2019-01-15 17:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177676  77 58498 61565054 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:06:23 [DEBUG   ] Got command RPT from MCS: ref #1177694
2019-01-15 17:06:23 [DEBUG   ] summary = ERROR
2019-01-15 17:06:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177694  13 58498 61583809 A  ERRORERROR'
2019-01-15 17:06:24 [DEBUG   ] Got command RPT from MCS: ref #1177695
2019-01-15 17:06:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:06:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177695  77 58498 61584013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:06:24 [DEBUG   ] Got command RPT from MCS: ref #1177696
2019-01-15 17:06:24 [DEBUG   ] summary = ERROR
2019-01-15 17:06:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177696  13 58498 61584217 A  ERRORERROR'
2019-01-15 17:06:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 17:06:24 [DEBUG   ] Got command RPT from MCS: ref #1177698
2019-01-15 17:06:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:06:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177698  77 58498 61584413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:06:24 [DEBUG   ] Got command RPT from MCS: ref #1177699
2019-01-15 17:06:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 17:06:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177699  12 58498 61584617 A  ERRORB—™š'
2019-01-15 17:06:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 17:06:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:06:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:06:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:06:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:06:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:06:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:06:46 [DEBUG   ] Finished updating board flags in 1.584 seconds
2019-01-15 17:07:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 17:07:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 17:07:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 17:07:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:07:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:07:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:07:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:07:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:07:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:07:46 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-15 17:08:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 17:08:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 17:08:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 17:08:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:08:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:08:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:08:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:08:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:08:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:08:46 [DEBUG   ] Finished updating board flags in 1.396 seconds
2019-01-15 17:09:05 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 17:09:25 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 17:09:45 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 17:09:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:09:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:09:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:09:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:09:46 [WARNING ] (13, 1, 'bot')
2019-01-15 17:09:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:09:46 [DEBUG   ] Finished updating board flags in 1.373 seconds
2019-01-15 17:10:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 17:10:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 17:10:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 17:10:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:10:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:10:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:10:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:10:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:10:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:10:47 [DEBUG   ] Finished updating board flags in 2.054 seconds
2019-01-15 17:11:05 [DEBUG   ] Got command RPT from MCS: ref #1177708
2019-01-15 17:11:05 [DEBUG   ] summary = ERROR
2019-01-15 17:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177708  13 58498 61865065 A  ERRORERROR'
2019-01-15 17:11:05 [DEBUG   ] Got command RPT from MCS: ref #1177709
2019-01-15 17:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177709  77 58498 61865066 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:11:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 17:11:23 [DEBUG   ] Got command RPT from MCS: ref #1177725
2019-01-15 17:11:23 [DEBUG   ] summary = ERROR
2019-01-15 17:11:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177725  13 58498 61883893 A  ERRORERROR'
2019-01-15 17:11:24 [DEBUG   ] Got command RPT from MCS: ref #1177726
2019-01-15 17:11:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:11:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177726  77 58498 61884097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:11:24 [DEBUG   ] Got command RPT from MCS: ref #1177727
2019-01-15 17:11:24 [DEBUG   ] summary = ERROR
2019-01-15 17:11:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177727  13 58498 61884289 A  ERRORERROR'
2019-01-15 17:11:24 [DEBUG   ] Got command RPT from MCS: ref #1177728
2019-01-15 17:11:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:11:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177728  77 58498 61884493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:11:24 [DEBUG   ] Got command RPT from MCS: ref #1177729
2019-01-15 17:11:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 17:11:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177729  12 58498 61884697 A  ERRORB–™š'
2019-01-15 17:11:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 17:11:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 17:11:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:11:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:11:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:11:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:11:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:11:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:11:47 [DEBUG   ] Finished updating board flags in 1.978 seconds
2019-01-15 17:12:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 17:12:25 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 17:12:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 17:12:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:12:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:12:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:12:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:12:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:12:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:12:47 [DEBUG   ] Finished updating board flags in 1.805 seconds
2019-01-15 17:13:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 17:13:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 17:13:45 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 17:13:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:13:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:13:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:13:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:13:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:13:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:13:47 [DEBUG   ] Finished updating board flags in 1.844 seconds
2019-01-15 17:14:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 17:14:25 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 17:14:45 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 17:14:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:14:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:14:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:14:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:14:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:14:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:14:47 [DEBUG   ] Finished updating board flags in 1.750 seconds
2019-01-15 17:15:06 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 17:15:26 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 17:15:46 [DEBUG   ] Finished updating ant stats in 1.246 seconds
2019-01-15 17:15:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:15:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:15:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:15:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:15:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:15:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:15:47 [DEBUG   ] Finished updating board flags in 1.622 seconds
2019-01-15 17:16:05 [DEBUG   ] Got command RPT from MCS: ref #1177738
2019-01-15 17:16:05 [DEBUG   ] summary = ERROR
2019-01-15 17:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177738  13 58498 62165057 A  ERRORERROR'
2019-01-15 17:16:05 [DEBUG   ] Got command RPT from MCS: ref #1177739
2019-01-15 17:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177739  77 58498 62165058 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:16:06 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2019-01-15 17:16:23 [DEBUG   ] Got command RPT from MCS: ref #1177757
2019-01-15 17:16:23 [DEBUG   ] summary = ERROR
2019-01-15 17:16:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177757  13 58498 62183969 A  ERRORERROR'
2019-01-15 17:16:24 [DEBUG   ] Got command RPT from MCS: ref #1177758
2019-01-15 17:16:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:16:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177758  77 58498 62184173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:16:24 [DEBUG   ] Got command RPT from MCS: ref #1177759
2019-01-15 17:16:24 [DEBUG   ] summary = ERROR
2019-01-15 17:16:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177759  13 58498 62184377 A  ERRORERROR'
2019-01-15 17:16:24 [DEBUG   ] Got command RPT from MCS: ref #1177761
2019-01-15 17:16:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:16:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177761  77 58498 62184569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:16:24 [DEBUG   ] Got command RPT from MCS: ref #1177763
2019-01-15 17:16:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 17:16:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177763  12 58498 62184773 A  ERRORB•™š'
2019-01-15 17:16:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 17:16:46 [DEBUG   ] Finished updating ant stats in 1.051 seconds
2019-01-15 17:16:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:16:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:16:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:16:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:16:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:16:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:16:47 [DEBUG   ] Finished updating board flags in 1.583 seconds
2019-01-15 17:17:06 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2019-01-15 17:17:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 17:17:46 [DEBUG   ] Finished updating ant stats in 0.849 seconds
2019-01-15 17:17:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:17:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:17:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:17:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:17:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:17:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:17:47 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-01-15 17:18:06 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2019-01-15 17:18:27 [DEBUG   ] Finished updating ant stats in 1.598 seconds
2019-01-15 17:18:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:18:47 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 17:18:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:18:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:18:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:18:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:18:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:18:47 [DEBUG   ] Finished updating board flags in 1.385 seconds
2019-01-15 17:19:07 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 17:19:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 17:19:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:19:47 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2019-01-15 17:19:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:19:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:19:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:19:47 [WARNING ] (13, 1, 'bot')
2019-01-15 17:19:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:19:47 [DEBUG   ] Finished updating board flags in 1.424 seconds
2019-01-15 17:20:07 [DEBUG   ] Finished updating ant stats in 0.960 seconds
2019-01-15 17:20:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 17:20:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 17:20:47 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2019-01-15 17:20:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:20:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 17:20:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:20:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:20:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:20:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:20:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:20:48 [DEBUG   ] Finished updating board flags in 2.189 seconds
2019-01-15 17:21:05 [DEBUG   ] Got command RPT from MCS: ref #1177775
2019-01-15 17:21:05 [DEBUG   ] summary = ERROR
2019-01-15 17:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177775  13 58498 62465057 A  ERRORERROR'
2019-01-15 17:21:05 [DEBUG   ] Got command RPT from MCS: ref #1177776
2019-01-15 17:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177776  77 58498 62465058 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:21:07 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2019-01-15 17:21:24 [DEBUG   ] Got command RPT from MCS: ref #1177792
2019-01-15 17:21:24 [DEBUG   ] summary = ERROR
2019-01-15 17:21:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177792  13 58498 62484053 A  ERRORERROR'
2019-01-15 17:21:24 [DEBUG   ] Got command RPT from MCS: ref #1177793
2019-01-15 17:21:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:21:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177793  77 58498 62484257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:21:24 [DEBUG   ] Got command RPT from MCS: ref #1177794
2019-01-15 17:21:24 [DEBUG   ] summary = ERROR
2019-01-15 17:21:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177794  13 58498 62484461 A  ERRORERROR'
2019-01-15 17:21:24 [DEBUG   ] Got command RPT from MCS: ref #1177795
2019-01-15 17:21:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:21:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177795  77 58498 62484653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:21:24 [DEBUG   ] Got command RPT from MCS: ref #1177796
2019-01-15 17:21:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 17:21:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177796  12 58498 62484857 A  ERRORB–™š'
2019-01-15 17:21:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 17:21:47 [DEBUG   ] Finished updating ant stats in 0.651 seconds
2019-01-15 17:21:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:21:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:21:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:21:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:21:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:21:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:21:48 [DEBUG   ] Finished updating board flags in 1.993 seconds
2019-01-15 17:22:07 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2019-01-15 17:22:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 17:22:47 [DEBUG   ] Finished updating ant stats in 0.450 seconds
2019-01-15 17:22:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:22:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:22:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:22:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:22:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:22:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:22:48 [DEBUG   ] Finished updating board flags in 1.814 seconds
2019-01-15 17:23:08 [DEBUG   ] Finished updating ant stats in 1.355 seconds
2019-01-15 17:23:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 17:23:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 17:23:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:23:48 [DEBUG   ] Finished updating ant stats in 1.249 seconds
2019-01-15 17:23:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:23:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:23:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:23:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:23:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:23:48 [DEBUG   ] Finished updating board flags in 1.847 seconds
2019-01-15 17:24:08 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2019-01-15 17:24:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 17:24:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:24:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 17:24:48 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2019-01-15 17:24:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:24:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:24:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:24:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:24:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:24:48 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-01-15 17:25:08 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2019-01-15 17:25:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 17:25:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:25:48 [DEBUG   ] Finished updating ant stats in 0.643 seconds
2019-01-15 17:25:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:25:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:25:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:25:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:25:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:25:48 [DEBUG   ] Finished updating board flags in 1.784 seconds
2019-01-15 17:26:05 [DEBUG   ] Got command RPT from MCS: ref #1177801
2019-01-15 17:26:05 [DEBUG   ] summary = ERROR
2019-01-15 17:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177801  13 58498 62765065 A  ERRORERROR'
2019-01-15 17:26:05 [DEBUG   ] Got command RPT from MCS: ref #1177802
2019-01-15 17:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177802  77 58498 62765066 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:26:08 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2019-01-15 17:26:24 [DEBUG   ] Got command RPT from MCS: ref #1177820
2019-01-15 17:26:24 [DEBUG   ] summary = ERROR
2019-01-15 17:26:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177820  13 58498 62784133 A  ERRORERROR'
2019-01-15 17:26:24 [DEBUG   ] Got command RPT from MCS: ref #1177821
2019-01-15 17:26:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:26:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177821  77 58498 62784337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:26:24 [DEBUG   ] Got command RPT from MCS: ref #1177822
2019-01-15 17:26:24 [DEBUG   ] summary = ERROR
2019-01-15 17:26:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177822  13 58498 62784541 A  ERRORERROR'
2019-01-15 17:26:24 [DEBUG   ] Got command RPT from MCS: ref #1177824
2019-01-15 17:26:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:26:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177824  77 58498 62784733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:26:24 [DEBUG   ] Got command RPT from MCS: ref #1177825
2019-01-15 17:26:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 17:26:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177825  12 58498 62784937 A  ERRORB—™š'
2019-01-15 17:26:29 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 17:26:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:26:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:26:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:26:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:26:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:26:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:26:48 [DEBUG   ] Finished updating board flags in 1.629 seconds
2019-01-15 17:26:49 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 17:27:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 17:27:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 17:27:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:27:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:27:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:27:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:27:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:27:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:27:48 [DEBUG   ] Finished updating board flags in 1.585 seconds
2019-01-15 17:27:49 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 17:28:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 17:28:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 17:28:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:28:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 17:28:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:28:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:28:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:28:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:28:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:28:49 [DEBUG   ] Finished updating board flags in 2.319 seconds
2019-01-15 17:29:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 17:29:29 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 17:29:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:29:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:29:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:29:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:29:48 [WARNING ] (13, 1, 'bot')
2019-01-15 17:29:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:29:48 [DEBUG   ] Finished updating board flags in 1.465 seconds
2019-01-15 17:29:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 17:30:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 17:30:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 17:30:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:30:49 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2019-01-15 17:30:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:30:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:30:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:30:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:30:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:30:49 [DEBUG   ] Finished updating board flags in 2.239 seconds
2019-01-15 17:31:05 [DEBUG   ] Got command RPT from MCS: ref #1177838
2019-01-15 17:31:05 [DEBUG   ] summary = ERROR
2019-01-15 17:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177838  13 58498 63065069 A  ERRORERROR'
2019-01-15 17:31:05 [DEBUG   ] Got command RPT from MCS: ref #1177839
2019-01-15 17:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177839  77 58498 63065070 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:31:09 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2019-01-15 17:31:24 [DEBUG   ] Got command RPT from MCS: ref #1177855
2019-01-15 17:31:24 [DEBUG   ] summary = ERROR
2019-01-15 17:31:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177855  13 58498 63084213 A  ERRORERROR'
2019-01-15 17:31:24 [DEBUG   ] Got command RPT from MCS: ref #1177856
2019-01-15 17:31:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:31:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177856  77 58498 63084417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:31:24 [DEBUG   ] Got command RPT from MCS: ref #1177857
2019-01-15 17:31:24 [DEBUG   ] summary = ERROR
2019-01-15 17:31:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177857  13 58498 63084621 A  ERRORERROR'
2019-01-15 17:31:24 [DEBUG   ] Got command RPT from MCS: ref #1177858
2019-01-15 17:31:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:31:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177858  77 58498 63084813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:31:25 [DEBUG   ] Got command RPT from MCS: ref #1177859
2019-01-15 17:31:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 17:31:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177859  12 58498 63085017 A  ERRORB•™š'
2019-01-15 17:31:30 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 17:31:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:31:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:31:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:31:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:31:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:31:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:31:49 [DEBUG   ] Finished updating board flags in 2.182 seconds
2019-01-15 17:31:50 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 17:32:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 17:32:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 17:32:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:32:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:32:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:32:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:32:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:32:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:32:49 [DEBUG   ] Finished updating board flags in 2.037 seconds
2019-01-15 17:32:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 17:33:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 17:33:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 17:33:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:33:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 17:33:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:33:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:33:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:33:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:33:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:33:49 [DEBUG   ] Finished updating board flags in 1.947 seconds
2019-01-15 17:33:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 17:34:10 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 17:34:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 17:34:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:34:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:34:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:34:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:34:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:34:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:34:49 [DEBUG   ] Finished updating board flags in 1.830 seconds
2019-01-15 17:34:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 17:35:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 17:35:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 17:35:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:35:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:35:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:35:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:35:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:35:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:35:49 [DEBUG   ] Finished updating board flags in 1.773 seconds
2019-01-15 17:35:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 17:36:05 [DEBUG   ] Got command RPT from MCS: ref #1177868
2019-01-15 17:36:05 [DEBUG   ] summary = ERROR
2019-01-15 17:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177868  13 58498 63365069 A  ERRORERROR'
2019-01-15 17:36:05 [DEBUG   ] Got command RPT from MCS: ref #1177869
2019-01-15 17:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177869  77 58498 63365070 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:36:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 17:36:24 [DEBUG   ] Got command RPT from MCS: ref #1177887
2019-01-15 17:36:24 [DEBUG   ] summary = ERROR
2019-01-15 17:36:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177887  13 58498 63384293 A  ERRORERROR'
2019-01-15 17:36:24 [DEBUG   ] Got command RPT from MCS: ref #1177888
2019-01-15 17:36:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:36:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177888  77 58498 63384497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:36:24 [DEBUG   ] Got command RPT from MCS: ref #1177889
2019-01-15 17:36:24 [DEBUG   ] summary = ERROR
2019-01-15 17:36:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177889  13 58498 63384689 A  ERRORERROR'
2019-01-15 17:36:24 [DEBUG   ] Got command RPT from MCS: ref #1177891
2019-01-15 17:36:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:36:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177891  77 58498 63384893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:36:25 [DEBUG   ] Got command RPT from MCS: ref #1177892
2019-01-15 17:36:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 17:36:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177892  12 58498 63385097 A  ERRORB”™š'
2019-01-15 17:36:30 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 17:36:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:36:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:36:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:36:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:36:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:36:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:36:49 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-01-15 17:36:50 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 17:37:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 17:37:31 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 17:37:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:37:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:37:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:37:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:37:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:37:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:37:49 [DEBUG   ] Finished updating board flags in 1.557 seconds
2019-01-15 17:37:51 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 17:38:11 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 17:38:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 17:38:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:38:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 17:38:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:38:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:38:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:38:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:38:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:38:49 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-01-15 17:38:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 17:39:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 17:39:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 17:39:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:39:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:39:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:39:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:39:49 [WARNING ] (13, 1, 'bot')
2019-01-15 17:39:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:39:49 [DEBUG   ] Finished updating board flags in 1.397 seconds
2019-01-15 17:39:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 17:40:11 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-01-15 17:40:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 17:40:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 17:40:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:40:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:40:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:40:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:40:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:40:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:40:50 [DEBUG   ] Finished updating board flags in 2.231 seconds
2019-01-15 17:40:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 17:41:05 [DEBUG   ] Got command RPT from MCS: ref #1177901
2019-01-15 17:41:05 [DEBUG   ] summary = ERROR
2019-01-15 17:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177901  13 58498 63665069 A  ERRORERROR'
2019-01-15 17:41:05 [DEBUG   ] Got command RPT from MCS: ref #1177902
2019-01-15 17:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177902  77 58498 63665070 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:41:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 17:41:24 [DEBUG   ] Got command RPT from MCS: ref #1177918
2019-01-15 17:41:24 [DEBUG   ] summary = ERROR
2019-01-15 17:41:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177918  13 58498 63684377 A  ERRORERROR'
2019-01-15 17:41:24 [DEBUG   ] Got command RPT from MCS: ref #1177919
2019-01-15 17:41:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:41:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177919  77 58498 63684569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:41:24 [DEBUG   ] Got command RPT from MCS: ref #1177920
2019-01-15 17:41:24 [DEBUG   ] summary = ERROR
2019-01-15 17:41:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177920  13 58498 63684773 A  ERRORERROR'
2019-01-15 17:41:24 [DEBUG   ] Got command RPT from MCS: ref #1177921
2019-01-15 17:41:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:41:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177921  77 58498 63684977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:41:25 [DEBUG   ] Got command RPT from MCS: ref #1177922
2019-01-15 17:41:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 17:41:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177922  12 58498 63685181 A  ERRORB–™š'
2019-01-15 17:41:31 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 17:41:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 17:41:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:41:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:41:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:41:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:41:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:41:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:41:50 [DEBUG   ] Finished updating board flags in 2.231 seconds
2019-01-15 17:41:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 17:42:12 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 17:42:32 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 17:42:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:42:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:42:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:42:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:42:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:42:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:42:50 [DEBUG   ] Finished updating board flags in 2.138 seconds
2019-01-15 17:42:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 17:43:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 17:43:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 17:43:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:43:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:43:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:43:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:43:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:43:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:43:50 [DEBUG   ] Finished updating board flags in 2.009 seconds
2019-01-15 17:43:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 17:44:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 17:44:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 17:44:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:44:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:44:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:44:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:44:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:44:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:44:50 [DEBUG   ] Finished updating board flags in 1.986 seconds
2019-01-15 17:44:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 17:45:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 17:45:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 17:45:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:45:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:45:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:45:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:45:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:45:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:45:50 [DEBUG   ] Finished updating board flags in 1.824 seconds
2019-01-15 17:45:52 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 17:46:05 [DEBUG   ] Got command RPT from MCS: ref #1177931
2019-01-15 17:46:05 [DEBUG   ] summary = ERROR
2019-01-15 17:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177931  13 58498 63965065 A  ERRORERROR'
2019-01-15 17:46:05 [DEBUG   ] Got command RPT from MCS: ref #1177932
2019-01-15 17:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177932  77 58498 63965066 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:46:12 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 17:46:24 [DEBUG   ] Got command RPT from MCS: ref #1177950
2019-01-15 17:46:24 [DEBUG   ] summary = ERROR
2019-01-15 17:46:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177950  13 58498 63984457 A  ERRORERROR'
2019-01-15 17:46:24 [DEBUG   ] Got command RPT from MCS: ref #1177951
2019-01-15 17:46:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:46:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177951  77 58498 63984661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:46:24 [DEBUG   ] Got command RPT from MCS: ref #1177952
2019-01-15 17:46:24 [DEBUG   ] summary = ERROR
2019-01-15 17:46:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177952  13 58498 63984853 A  ERRORERROR'
2019-01-15 17:46:25 [DEBUG   ] Got command RPT from MCS: ref #1177954
2019-01-15 17:46:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:46:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177954  77 58498 63985057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:46:25 [DEBUG   ] Got command RPT from MCS: ref #1177955
2019-01-15 17:46:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 17:46:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177955  12 58498 63985261 A  ERRORB—™š'
2019-01-15 17:46:33 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 17:46:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:46:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:46:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:46:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:46:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:46:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:46:50 [DEBUG   ] Finished updating board flags in 1.804 seconds
2019-01-15 17:46:53 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 17:47:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 17:47:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 17:47:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:47:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:47:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:47:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:47:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:47:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:47:50 [DEBUG   ] Finished updating board flags in 1.783 seconds
2019-01-15 17:47:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 17:48:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 17:48:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 17:48:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:48:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 17:48:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:48:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:48:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:48:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:48:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:48:50 [DEBUG   ] Finished updating board flags in 1.609 seconds
2019-01-15 17:48:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 17:49:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 17:49:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 17:49:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:49:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:49:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:49:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:49:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:49:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:49:50 [DEBUG   ] Finished updating board flags in 1.609 seconds
2019-01-15 17:49:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 17:50:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 17:50:33 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 17:50:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:50:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:50:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:50:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:50:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:50:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:50:50 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-01-15 17:50:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 17:51:05 [DEBUG   ] Got command RPT from MCS: ref #1177968
2019-01-15 17:51:05 [DEBUG   ] summary = ERROR
2019-01-15 17:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177968  13 58498 64265073 A  ERRORERROR'
2019-01-15 17:51:05 [DEBUG   ] Got command RPT from MCS: ref #1177969
2019-01-15 17:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177969  77 58498 64265074 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:51:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 17:51:24 [DEBUG   ] Got command RPT from MCS: ref #1177985
2019-01-15 17:51:24 [DEBUG   ] summary = ERROR
2019-01-15 17:51:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177985  13 58498 64284537 A  ERRORERROR'
2019-01-15 17:51:24 [DEBUG   ] Got command RPT from MCS: ref #1177986
2019-01-15 17:51:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:51:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177986  77 58498 64284741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:51:24 [DEBUG   ] Got command RPT from MCS: ref #1177987
2019-01-15 17:51:24 [DEBUG   ] summary = ERROR
2019-01-15 17:51:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177987  13 58498 64284933 A  ERRORERROR'
2019-01-15 17:51:25 [DEBUG   ] Got command RPT from MCS: ref #1177988
2019-01-15 17:51:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:51:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177988  77 58498 64285137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:51:25 [DEBUG   ] Got command RPT from MCS: ref #1177989
2019-01-15 17:51:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 17:51:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177989  12 58498 64285341 A  ERRORB–™š'
2019-01-15 17:51:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 17:51:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:51:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 17:51:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:51:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:51:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:51:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:51:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:51:50 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-15 17:51:53 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 17:52:14 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 17:52:33 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 17:52:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:52:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:52:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:52:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:52:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:52:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:52:50 [DEBUG   ] Finished updating board flags in 1.559 seconds
2019-01-15 17:52:54 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 17:53:14 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 17:53:34 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 17:53:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:53:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:53:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:53:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:53:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:53:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:53:50 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-01-15 17:53:54 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-01-15 17:54:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 17:54:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 17:54:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:54:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:54:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:54:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:54:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:54:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:54:50 [DEBUG   ] Finished updating board flags in 1.396 seconds
2019-01-15 17:54:54 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 17:55:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 17:55:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 17:55:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:55:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:55:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:55:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:55:50 [WARNING ] (13, 1, 'bot')
2019-01-15 17:55:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:55:50 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-01-15 17:55:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 17:56:05 [DEBUG   ] Got command RPT from MCS: ref #1177994
2019-01-15 17:56:05 [DEBUG   ] summary = ERROR
2019-01-15 17:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177994  13 58498 64565069 A  ERRORERROR'
2019-01-15 17:56:05 [DEBUG   ] Got command RPT from MCS: ref #1177995
2019-01-15 17:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1177995  77 58498 64565070 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:56:14 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 17:56:24 [DEBUG   ] Got command RPT from MCS: ref #1178013
2019-01-15 17:56:24 [DEBUG   ] summary = ERROR
2019-01-15 17:56:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178013  13 58498 64584617 A  ERRORERROR'
2019-01-15 17:56:24 [DEBUG   ] Got command RPT from MCS: ref #1178014
2019-01-15 17:56:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:56:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178014  77 58498 64584809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:56:25 [DEBUG   ] Got command RPT from MCS: ref #1178015
2019-01-15 17:56:25 [DEBUG   ] summary = ERROR
2019-01-15 17:56:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178015  13 58498 64585013 A  ERRORERROR'
2019-01-15 17:56:25 [DEBUG   ] Got command RPT from MCS: ref #1178017
2019-01-15 17:56:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 17:56:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178017  77 58498 64585217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 17:56:25 [DEBUG   ] Got command RPT from MCS: ref #1178019
2019-01-15 17:56:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 17:56:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178019  12 58498 64585421 A  ERRORB”™š'
2019-01-15 17:56:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 17:56:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:56:51 [WARNING ] (13, 1, 'bot')
2019-01-15 17:56:51 [WARNING ] (13, 1, 'bot')
2019-01-15 17:56:51 [WARNING ] (13, 1, 'bot')
2019-01-15 17:56:51 [WARNING ] (13, 1, 'bot')
2019-01-15 17:56:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:56:51 [DEBUG   ] Finished updating board flags in 2.014 seconds
2019-01-15 17:56:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 17:57:15 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 17:57:35 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 17:57:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:57:51 [WARNING ] (13, 1, 'bot')
2019-01-15 17:57:51 [WARNING ] (13, 1, 'bot')
2019-01-15 17:57:51 [WARNING ] (13, 1, 'bot')
2019-01-15 17:57:51 [WARNING ] (13, 1, 'bot')
2019-01-15 17:57:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:57:51 [DEBUG   ] Finished updating board flags in 2.012 seconds
2019-01-15 17:57:55 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 17:58:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 17:58:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 17:58:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:58:51 [WARNING ] (13, 1, 'bot')
2019-01-15 17:58:51 [WARNING ] (13, 1, 'bot')
2019-01-15 17:58:51 [WARNING ] (13, 1, 'bot')
2019-01-15 17:58:51 [WARNING ] (13, 1, 'bot')
2019-01-15 17:58:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:58:51 [DEBUG   ] Finished updating board flags in 1.983 seconds
2019-01-15 17:58:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 17:59:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 17:59:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 17:59:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 17:59:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 17:59:51 [WARNING ] (13, 1, 'bot')
2019-01-15 17:59:51 [WARNING ] (13, 1, 'bot')
2019-01-15 17:59:51 [WARNING ] (13, 1, 'bot')
2019-01-15 17:59:51 [WARNING ] (13, 1, 'bot')
2019-01-15 17:59:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 17:59:51 [DEBUG   ] Finished updating board flags in 1.819 seconds
2019-01-15 17:59:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 18:00:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 18:00:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 18:00:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:00:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 18:00:51 [WARNING ] (13, 1, 'bot')
2019-01-15 18:00:51 [WARNING ] (13, 1, 'bot')
2019-01-15 18:00:51 [WARNING ] (13, 1, 'bot')
2019-01-15 18:00:51 [WARNING ] (13, 1, 'bot')
2019-01-15 18:00:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:00:51 [DEBUG   ] Finished updating board flags in 1.796 seconds
2019-01-15 18:00:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 18:01:05 [DEBUG   ] Got command RPT from MCS: ref #1178031
2019-01-15 18:01:05 [DEBUG   ] summary = ERROR
2019-01-15 18:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178031  13 58498 64865069 A  ERRORERROR'
2019-01-15 18:01:05 [DEBUG   ] Got command RPT from MCS: ref #1178032
2019-01-15 18:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178032  77 58498 64865070 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:01:15 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 18:01:24 [DEBUG   ] Got command RPT from MCS: ref #1178048
2019-01-15 18:01:24 [DEBUG   ] summary = ERROR
2019-01-15 18:01:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178048  13 58498 64884689 A  ERRORERROR'
2019-01-15 18:01:24 [DEBUG   ] Got command RPT from MCS: ref #1178049
2019-01-15 18:01:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:01:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178049  77 58498 64884894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:01:25 [DEBUG   ] Got command RPT from MCS: ref #1178050
2019-01-15 18:01:25 [DEBUG   ] summary = ERROR
2019-01-15 18:01:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178050  13 58498 64885097 A  ERRORERROR'
2019-01-15 18:01:25 [DEBUG   ] Got command RPT from MCS: ref #1178051
2019-01-15 18:01:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:01:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178051  77 58498 64885301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:01:25 [DEBUG   ] Got command RPT from MCS: ref #1178052
2019-01-15 18:01:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 18:01:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178052  12 58498 64885493 A  ERRORB–™š'
2019-01-15 18:01:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 18:01:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:01:51 [WARNING ] (13, 1, 'bot')
2019-01-15 18:01:51 [WARNING ] (13, 1, 'bot')
2019-01-15 18:01:51 [WARNING ] (13, 1, 'bot')
2019-01-15 18:01:51 [WARNING ] (13, 1, 'bot')
2019-01-15 18:01:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:01:51 [DEBUG   ] Finished updating board flags in 1.631 seconds
2019-01-15 18:01:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 18:02:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 18:02:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 18:02:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:02:51 [WARNING ] (13, 1, 'bot')
2019-01-15 18:02:51 [WARNING ] (13, 1, 'bot')
2019-01-15 18:02:51 [WARNING ] (13, 1, 'bot')
2019-01-15 18:02:51 [WARNING ] (13, 1, 'bot')
2019-01-15 18:02:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:02:51 [DEBUG   ] Finished updating board flags in 1.574 seconds
2019-01-15 18:02:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 18:03:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 18:03:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 18:03:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:03:51 [WARNING ] (13, 1, 'bot')
2019-01-15 18:03:51 [WARNING ] (13, 1, 'bot')
2019-01-15 18:03:51 [WARNING ] (13, 1, 'bot')
2019-01-15 18:03:51 [WARNING ] (13, 1, 'bot')
2019-01-15 18:03:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:03:51 [DEBUG   ] Finished updating board flags in 1.408 seconds
2019-01-15 18:03:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 18:04:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 18:04:36 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 18:04:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:04:51 [WARNING ] (13, 1, 'bot')
2019-01-15 18:04:51 [WARNING ] (13, 1, 'bot')
2019-01-15 18:04:51 [WARNING ] (13, 1, 'bot')
2019-01-15 18:04:51 [WARNING ] (13, 1, 'bot')
2019-01-15 18:04:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:04:51 [DEBUG   ] Finished updating board flags in 1.396 seconds
2019-01-15 18:04:56 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 18:05:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 18:05:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 18:05:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:05:51 [WARNING ] (13, 1, 'bot')
2019-01-15 18:05:51 [WARNING ] (13, 1, 'bot')
2019-01-15 18:05:51 [WARNING ] (13, 1, 'bot')
2019-01-15 18:05:51 [WARNING ] (13, 1, 'bot')
2019-01-15 18:05:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:05:51 [DEBUG   ] Finished updating board flags in 1.390 seconds
2019-01-15 18:05:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 18:06:05 [DEBUG   ] Got command RPT from MCS: ref #1178061
2019-01-15 18:06:05 [DEBUG   ] summary = ERROR
2019-01-15 18:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178061  13 58498 65165069 A  ERRORERROR'
2019-01-15 18:06:05 [DEBUG   ] Got command RPT from MCS: ref #1178062
2019-01-15 18:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178062  77 58498 65165070 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:06:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 18:06:24 [DEBUG   ] Got command RPT from MCS: ref #1178080
2019-01-15 18:06:24 [DEBUG   ] summary = ERROR
2019-01-15 18:06:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178080  13 58498 65184773 A  ERRORERROR'
2019-01-15 18:06:24 [DEBUG   ] Got command RPT from MCS: ref #1178081
2019-01-15 18:06:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:06:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178081  77 58498 65184977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:06:25 [DEBUG   ] Got command RPT from MCS: ref #1178082
2019-01-15 18:06:25 [DEBUG   ] summary = ERROR
2019-01-15 18:06:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178082  13 58498 65185181 A  ERRORERROR'
2019-01-15 18:06:25 [DEBUG   ] Got command RPT from MCS: ref #1178084
2019-01-15 18:06:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:06:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178084  77 58498 65185373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:06:25 [DEBUG   ] Got command RPT from MCS: ref #1178085
2019-01-15 18:06:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 18:06:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178085  12 58498 65185577 A  ERRORB—™š'
2019-01-15 18:06:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 18:06:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:06:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:06:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:06:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:06:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:06:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:06:52 [DEBUG   ] Finished updating board flags in 2.041 seconds
2019-01-15 18:06:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 18:07:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 18:07:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 18:07:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:07:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:07:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:07:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:07:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:07:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:07:52 [DEBUG   ] Finished updating board flags in 2.009 seconds
2019-01-15 18:07:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 18:08:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 18:08:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 18:08:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:08:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:08:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:08:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:08:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:08:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:08:52 [DEBUG   ] Finished updating board flags in 1.964 seconds
2019-01-15 18:08:56 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 18:09:17 [DEBUG   ] Finished updating ant stats in 1.599 seconds
2019-01-15 18:09:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 18:09:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:09:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:09:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:09:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:09:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:09:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:09:52 [DEBUG   ] Finished updating board flags in 1.807 seconds
2019-01-15 18:09:56 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 18:10:16 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-15 18:10:37 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-15 18:10:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:10:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:10:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:10:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:10:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:10:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:10:52 [DEBUG   ] Finished updating board flags in 1.798 seconds
2019-01-15 18:10:57 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 18:11:05 [DEBUG   ] Got command RPT from MCS: ref #1178094
2019-01-15 18:11:05 [DEBUG   ] summary = ERROR
2019-01-15 18:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178094  13 58498 65465069 A  ERRORERROR'
2019-01-15 18:11:05 [DEBUG   ] Got command RPT from MCS: ref #1178095
2019-01-15 18:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178095  77 58498 65465070 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:11:17 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 18:11:24 [DEBUG   ] Got command RPT from MCS: ref #1178111
2019-01-15 18:11:24 [DEBUG   ] summary = ERROR
2019-01-15 18:11:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178111  13 58498 65484857 A  ERRORERROR'
2019-01-15 18:11:25 [DEBUG   ] Got command RPT from MCS: ref #1178112
2019-01-15 18:11:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:11:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178112  77 58498 65485061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:11:25 [DEBUG   ] Got command RPT from MCS: ref #1178113
2019-01-15 18:11:25 [DEBUG   ] summary = ERROR
2019-01-15 18:11:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178113  13 58498 65485253 A  ERRORERROR'
2019-01-15 18:11:25 [DEBUG   ] Got command RPT from MCS: ref #1178114
2019-01-15 18:11:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:11:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178114  77 58498 65485457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:11:25 [DEBUG   ] Got command RPT from MCS: ref #1178115
2019-01-15 18:11:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 18:11:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178115  12 58498 65485661 A  ERRORB•™š'
2019-01-15 18:11:37 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 18:11:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:11:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:11:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:11:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:11:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:11:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:11:52 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-01-15 18:11:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 18:12:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 18:12:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 18:12:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:12:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:12:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:12:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:12:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:12:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:12:52 [DEBUG   ] Finished updating board flags in 1.585 seconds
2019-01-15 18:12:57 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2019-01-15 18:13:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 18:13:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 18:13:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:13:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:13:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:13:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:13:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:13:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:13:52 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-01-15 18:13:57 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 18:14:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 18:14:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 18:14:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:14:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 18:14:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:14:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:14:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:14:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:14:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:14:52 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-01-15 18:14:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 18:15:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 18:15:37 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 18:15:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:15:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:15:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:15:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:15:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:15:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:15:52 [DEBUG   ] Finished updating board flags in 1.465 seconds
2019-01-15 18:15:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 18:16:05 [DEBUG   ] Got command RPT from MCS: ref #1178124
2019-01-15 18:16:05 [DEBUG   ] summary = ERROR
2019-01-15 18:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178124  13 58498 65765077 A  ERRORERROR'
2019-01-15 18:16:05 [DEBUG   ] Got command RPT from MCS: ref #1178125
2019-01-15 18:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178125  77 58498 65765078 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:16:17 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 18:16:24 [DEBUG   ] Got command RPT from MCS: ref #1178143
2019-01-15 18:16:24 [DEBUG   ] summary = ERROR
2019-01-15 18:16:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178143  13 58498 65784933 A  ERRORERROR'
2019-01-15 18:16:25 [DEBUG   ] Got command RPT from MCS: ref #1178144
2019-01-15 18:16:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:16:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178144  77 58498 65785137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:16:25 [DEBUG   ] Got command RPT from MCS: ref #1178145
2019-01-15 18:16:25 [DEBUG   ] summary = ERROR
2019-01-15 18:16:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178145  13 58498 65785341 A  ERRORERROR'
2019-01-15 18:16:25 [DEBUG   ] Got command RPT from MCS: ref #1178147
2019-01-15 18:16:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:16:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178147  77 58498 65785545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:16:25 [DEBUG   ] Got command RPT from MCS: ref #1178148
2019-01-15 18:16:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 18:16:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178148  12 58498 65785737 A  ERRORB”™š'
2019-01-15 18:16:38 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 18:16:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:16:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:16:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:16:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:16:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:16:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:16:52 [DEBUG   ] Finished updating board flags in 1.464 seconds
2019-01-15 18:16:58 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 18:17:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 18:17:38 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 18:17:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:17:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 18:17:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:17:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:17:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:17:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:17:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:17:52 [DEBUG   ] Finished updating board flags in 1.463 seconds
2019-01-15 18:17:58 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 18:18:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 18:18:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 18:18:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:18:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:18:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:18:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:18:52 [WARNING ] (13, 1, 'bot')
2019-01-15 18:18:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:18:52 [DEBUG   ] Finished updating board flags in 1.465 seconds
2019-01-15 18:18:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 18:19:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 18:19:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 18:19:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:19:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:19:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:19:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:19:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:19:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:19:53 [DEBUG   ] Finished updating board flags in 2.201 seconds
2019-01-15 18:19:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 18:20:18 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-01-15 18:20:39 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 18:20:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:20:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 18:20:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:20:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:20:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:20:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:20:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:20:53 [DEBUG   ] Finished updating board flags in 2.135 seconds
2019-01-15 18:20:59 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 18:21:05 [DEBUG   ] Got command RPT from MCS: ref #1178161
2019-01-15 18:21:05 [DEBUG   ] summary = ERROR
2019-01-15 18:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178161  13 58498 66065073 A  ERRORERROR'
2019-01-15 18:21:05 [DEBUG   ] Got command RPT from MCS: ref #1178162
2019-01-15 18:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178162  77 58498 66065074 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:21:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 18:21:25 [DEBUG   ] Got command RPT from MCS: ref #1178178
2019-01-15 18:21:25 [DEBUG   ] summary = ERROR
2019-01-15 18:21:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178178  13 58498 66085017 A  ERRORERROR'
2019-01-15 18:21:25 [DEBUG   ] Got command RPT from MCS: ref #1178179
2019-01-15 18:21:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:21:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178179  77 58498 66085221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:21:25 [DEBUG   ] Got command RPT from MCS: ref #1178180
2019-01-15 18:21:25 [DEBUG   ] summary = ERROR
2019-01-15 18:21:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178180  13 58498 66085425 A  ERRORERROR'
2019-01-15 18:21:25 [DEBUG   ] Got command RPT from MCS: ref #1178181
2019-01-15 18:21:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:21:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178181  77 58498 66085617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:21:25 [DEBUG   ] Got command RPT from MCS: ref #1178182
2019-01-15 18:21:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 18:21:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178182  12 58498 66085821 A  ERRORB”™š'
2019-01-15 18:21:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 18:21:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:21:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:21:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:21:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:21:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:21:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:21:53 [DEBUG   ] Finished updating board flags in 2.016 seconds
2019-01-15 18:21:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 18:22:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 18:22:39 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 18:22:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:22:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 18:22:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:22:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:22:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:22:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:22:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:22:53 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-01-15 18:22:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 18:23:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 18:23:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 18:23:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-15 18:23:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:23:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 18:23:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:23:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:23:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:23:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:23:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:23:53 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-01-15 18:23:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 18:24:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 18:24:39 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 18:24:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:24:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 18:24:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-15 18:24:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:24:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:24:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:24:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:24:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:24:53 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-01-15 18:24:59 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-15 18:25:20 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-15 18:25:40 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 18:25:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:25:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:25:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:25:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:25:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:25:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:25:53 [DEBUG   ] Finished updating board flags in 1.787 seconds
2019-01-15 18:26:00 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 18:26:05 [DEBUG   ] Got command RPT from MCS: ref #1178187
2019-01-15 18:26:05 [DEBUG   ] summary = ERROR
2019-01-15 18:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178187  13 58498 66365077 A  ERRORERROR'
2019-01-15 18:26:05 [DEBUG   ] Got command RPT from MCS: ref #1178188
2019-01-15 18:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178188  77 58498 66365078 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:26:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 18:26:25 [DEBUG   ] Got command RPT from MCS: ref #1178206
2019-01-15 18:26:25 [DEBUG   ] summary = ERROR
2019-01-15 18:26:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178206  13 58498 66385093 A  ERRORERROR'
2019-01-15 18:26:25 [DEBUG   ] Got command RPT from MCS: ref #1178207
2019-01-15 18:26:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:26:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178207  77 58498 66385297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:26:25 [DEBUG   ] Got command RPT from MCS: ref #1178208
2019-01-15 18:26:25 [DEBUG   ] summary = ERROR
2019-01-15 18:26:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178208  13 58498 66385501 A  ERRORERROR'
2019-01-15 18:26:25 [DEBUG   ] Got command RPT from MCS: ref #1178210
2019-01-15 18:26:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:26:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178210  77 58498 66385693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:26:25 [DEBUG   ] Got command RPT from MCS: ref #1178211
2019-01-15 18:26:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 18:26:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178211  12 58498 66385897 A  ERRORB—™š'
2019-01-15 18:26:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 18:26:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:26:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:26:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:26:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:26:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:26:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:26:53 [DEBUG   ] Finished updating board flags in 1.598 seconds
2019-01-15 18:27:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 18:27:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 18:27:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 18:27:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:27:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:27:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:27:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:27:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:27:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:27:53 [DEBUG   ] Finished updating board flags in 1.406 seconds
2019-01-15 18:28:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 18:28:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 18:28:40 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 18:28:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 18:28:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:28:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:28:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:28:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:28:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:28:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:28:53 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-01-15 18:29:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 18:29:20 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 18:29:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 18:29:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:29:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:29:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:29:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:29:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:29:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:29:53 [DEBUG   ] Finished updating board flags in 1.392 seconds
2019-01-15 18:30:01 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-15 18:30:21 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 18:30:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 18:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:30:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:30:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:30:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:30:53 [WARNING ] (13, 1, 'bot')
2019-01-15 18:30:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:30:53 [DEBUG   ] Finished updating board flags in 1.356 seconds
2019-01-15 18:31:01 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 18:31:05 [DEBUG   ] Got command RPT from MCS: ref #1178224
2019-01-15 18:31:05 [DEBUG   ] summary = ERROR
2019-01-15 18:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178224  13 58498 66665081 A  ERRORERROR'
2019-01-15 18:31:05 [DEBUG   ] Got command RPT from MCS: ref #1178225
2019-01-15 18:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178225  77 58498 66665082 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:31:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 18:31:25 [DEBUG   ] Got command RPT from MCS: ref #1178241
2019-01-15 18:31:25 [DEBUG   ] summary = ERROR
2019-01-15 18:31:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178241  13 58498 66685169 A  ERRORERROR'
2019-01-15 18:31:25 [DEBUG   ] Got command RPT from MCS: ref #1178242
2019-01-15 18:31:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:31:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178242  77 58498 66685373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:31:25 [DEBUG   ] Got command RPT from MCS: ref #1178243
2019-01-15 18:31:25 [DEBUG   ] summary = ERROR
2019-01-15 18:31:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178243  13 58498 66685577 A  ERRORERROR'
2019-01-15 18:31:25 [DEBUG   ] Got command RPT from MCS: ref #1178244
2019-01-15 18:31:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:31:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178244  77 58498 66685781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:31:25 [DEBUG   ] Got command RPT from MCS: ref #1178245
2019-01-15 18:31:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 18:31:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178245  12 58498 66685973 A  ERRORB–™š'
2019-01-15 18:31:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 18:31:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:31:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:31:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:31:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:31:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:31:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:31:54 [DEBUG   ] Finished updating board flags in 2.049 seconds
2019-01-15 18:32:01 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2019-01-15 18:32:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 18:32:41 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 18:32:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:32:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:32:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:32:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:32:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:32:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:32:54 [DEBUG   ] Finished updating board flags in 2.015 seconds
2019-01-15 18:33:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 18:33:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 18:33:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 18:33:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:33:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:33:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:33:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:33:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:33:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:33:54 [DEBUG   ] Finished updating board flags in 1.979 seconds
2019-01-15 18:34:01 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 18:34:22 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-15 18:34:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 18:34:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:34:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:34:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:34:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:34:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:34:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:34:54 [DEBUG   ] Finished updating board flags in 1.822 seconds
2019-01-15 18:35:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 18:35:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 18:35:42 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 18:35:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:35:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:35:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:35:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:35:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:35:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:35:54 [DEBUG   ] Finished updating board flags in 1.797 seconds
2019-01-15 18:36:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 18:36:05 [DEBUG   ] Got command RPT from MCS: ref #1178254
2019-01-15 18:36:05 [DEBUG   ] summary = ERROR
2019-01-15 18:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178254  13 58498 66965085 A  ERRORERROR'
2019-01-15 18:36:05 [DEBUG   ] Got command RPT from MCS: ref #1178255
2019-01-15 18:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178255  77 58498 66965086 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:36:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 18:36:25 [DEBUG   ] Got command RPT from MCS: ref #1178273
2019-01-15 18:36:25 [DEBUG   ] summary = ERROR
2019-01-15 18:36:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178273  13 58498 66985257 A  ERRORERROR'
2019-01-15 18:36:25 [DEBUG   ] Got command RPT from MCS: ref #1178274
2019-01-15 18:36:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:36:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178274  77 58498 66985461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:36:25 [DEBUG   ] Got command RPT from MCS: ref #1178275
2019-01-15 18:36:25 [DEBUG   ] summary = ERROR
2019-01-15 18:36:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178275  13 58498 66985653 A  ERRORERROR'
2019-01-15 18:36:25 [DEBUG   ] Got command RPT from MCS: ref #1178277
2019-01-15 18:36:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:36:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178277  77 58498 66985857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:36:26 [DEBUG   ] Got command RPT from MCS: ref #1178278
2019-01-15 18:36:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 18:36:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178278  12 58498 66986061 A  ERRORB•™š'
2019-01-15 18:36:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 18:36:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:36:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:36:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:36:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:36:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:36:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:36:54 [DEBUG   ] Finished updating board flags in 1.596 seconds
2019-01-15 18:37:02 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 18:37:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 18:37:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 18:37:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:37:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 18:37:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:37:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:37:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:37:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:37:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:37:54 [DEBUG   ] Finished updating board flags in 1.399 seconds
2019-01-15 18:38:02 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 18:38:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 18:38:42 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 18:38:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:38:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:38:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:38:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:38:54 [WARNING ] (13, 1, 'bot')
2019-01-15 18:38:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:38:54 [DEBUG   ] Finished updating board flags in 1.378 seconds
2019-01-15 18:39:03 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 18:39:23 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 18:39:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 18:39:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:39:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:39:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:39:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:39:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:39:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:39:55 [DEBUG   ] Finished updating board flags in 2.052 seconds
2019-01-15 18:40:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 18:40:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 18:40:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 18:40:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:40:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:40:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:40:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:40:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:40:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:40:55 [DEBUG   ] Finished updating board flags in 1.981 seconds
2019-01-15 18:41:03 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 18:41:05 [DEBUG   ] Got command RPT from MCS: ref #1178287
2019-01-15 18:41:05 [DEBUG   ] summary = ERROR
2019-01-15 18:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178287  13 58498 67265085 A  ERRORERROR'
2019-01-15 18:41:05 [DEBUG   ] Got command RPT from MCS: ref #1178288
2019-01-15 18:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178288  77 58498 67265086 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:41:23 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 18:41:25 [DEBUG   ] Got command RPT from MCS: ref #1178304
2019-01-15 18:41:25 [DEBUG   ] summary = ERROR
2019-01-15 18:41:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178304  13 58498 67285333 A  ERRORERROR'
2019-01-15 18:41:25 [DEBUG   ] Got command RPT from MCS: ref #1178305
2019-01-15 18:41:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:41:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178305  77 58498 67285537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:41:25 [DEBUG   ] Got command RPT from MCS: ref #1178306
2019-01-15 18:41:25 [DEBUG   ] summary = ERROR
2019-01-15 18:41:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178306  13 58498 67285741 A  ERRORERROR'
2019-01-15 18:41:25 [DEBUG   ] Got command RPT from MCS: ref #1178307
2019-01-15 18:41:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:41:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178307  77 58498 67285933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:41:26 [DEBUG   ] Got command RPT from MCS: ref #1178308
2019-01-15 18:41:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 18:41:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178308  12 58498 67286137 A  ERRORB”™š'
2019-01-15 18:41:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 18:41:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:41:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:41:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:41:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:41:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:41:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:41:55 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-01-15 18:42:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 18:42:23 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 18:42:43 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 18:42:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:42:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:42:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:42:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:42:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:42:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:42:55 [DEBUG   ] Finished updating board flags in 1.795 seconds
2019-01-15 18:43:03 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 18:43:24 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-15 18:43:44 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 18:43:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:43:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:43:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:43:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:43:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:43:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:43:55 [DEBUG   ] Finished updating board flags in 1.595 seconds
2019-01-15 18:44:04 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 18:44:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 18:44:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 18:44:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-15 18:44:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:44:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:44:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:44:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:44:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:44:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:44:55 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-01-15 18:45:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 18:45:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 18:45:44 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 18:45:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:45:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 18:45:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:45:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:45:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:45:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:45:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:45:55 [DEBUG   ] Finished updating board flags in 1.392 seconds
2019-01-15 18:46:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 18:46:05 [DEBUG   ] Got command RPT from MCS: ref #1178317
2019-01-15 18:46:05 [DEBUG   ] summary = ERROR
2019-01-15 18:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178317  13 58498 67565081 A  ERRORERROR'
2019-01-15 18:46:05 [DEBUG   ] Got command RPT from MCS: ref #1178318
2019-01-15 18:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178318  77 58498 67565082 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:46:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 18:46:25 [DEBUG   ] Got command RPT from MCS: ref #1178336
2019-01-15 18:46:25 [DEBUG   ] summary = ERROR
2019-01-15 18:46:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178336  13 58498 67585409 A  ERRORERROR'
2019-01-15 18:46:25 [DEBUG   ] Got command RPT from MCS: ref #1178337
2019-01-15 18:46:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:46:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178337  77 58498 67585613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:46:25 [DEBUG   ] Got command RPT from MCS: ref #1178338
2019-01-15 18:46:25 [DEBUG   ] summary = ERROR
2019-01-15 18:46:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178338  13 58498 67585817 A  ERRORERROR'
2019-01-15 18:46:26 [DEBUG   ] Got command RPT from MCS: ref #1178340
2019-01-15 18:46:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:46:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178340  77 58498 67586021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:46:26 [DEBUG   ] Got command RPT from MCS: ref #1178342
2019-01-15 18:46:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 18:46:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178342  12 58498 67586213 A  ERRORB—™š'
2019-01-15 18:46:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 18:46:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:46:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:46:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:46:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:46:55 [WARNING ] (13, 1, 'bot')
2019-01-15 18:46:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:46:55 [DEBUG   ] Finished updating board flags in 1.351 seconds
2019-01-15 18:47:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 18:47:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 18:47:45 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 18:47:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:47:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 18:47:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:47:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:47:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:47:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:47:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:47:56 [DEBUG   ] Finished updating board flags in 2.067 seconds
2019-01-15 18:48:05 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 18:48:25 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 18:48:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 18:48:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:48:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:48:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:48:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:48:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:48:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:48:56 [DEBUG   ] Finished updating board flags in 1.995 seconds
2019-01-15 18:49:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 18:49:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 18:49:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 18:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:49:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:49:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:49:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:49:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:49:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:49:56 [DEBUG   ] Finished updating board flags in 1.870 seconds
2019-01-15 18:50:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 18:50:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 18:50:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 18:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:50:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:50:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:50:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:50:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:50:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:50:56 [DEBUG   ] Finished updating board flags in 1.775 seconds
2019-01-15 18:51:05 [DEBUG   ] Got command RPT from MCS: ref #1178354
2019-01-15 18:51:05 [DEBUG   ] summary = ERROR
2019-01-15 18:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178354  13 58498 67865081 A  ERRORERROR'
2019-01-15 18:51:05 [DEBUG   ] Got command RPT from MCS: ref #1178355
2019-01-15 18:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178355  77 58498 67865082 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:51:05 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 18:51:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 18:51:25 [DEBUG   ] Got command RPT from MCS: ref #1178371
2019-01-15 18:51:25 [DEBUG   ] summary = ERROR
2019-01-15 18:51:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178371  13 58498 67885493 A  ERRORERROR'
2019-01-15 18:51:25 [DEBUG   ] Got command RPT from MCS: ref #1178372
2019-01-15 18:51:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:51:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178372  77 58498 67885697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:51:25 [DEBUG   ] Got command RPT from MCS: ref #1178373
2019-01-15 18:51:25 [DEBUG   ] summary = ERROR
2019-01-15 18:51:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178373  13 58498 67885901 A  ERRORERROR'
2019-01-15 18:51:26 [DEBUG   ] Got command RPT from MCS: ref #1178374
2019-01-15 18:51:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:51:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178374  77 58498 67886093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:51:26 [DEBUG   ] Got command RPT from MCS: ref #1178375
2019-01-15 18:51:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 18:51:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178375  12 58498 67886297 A  ERRORB—™š'
2019-01-15 18:51:45 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 18:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:51:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 18:51:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 18:51:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:51:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:51:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:51:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:51:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:51:56 [DEBUG   ] Finished updating board flags in 1.571 seconds
2019-01-15 18:52:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 18:52:25 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 18:52:46 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 18:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:52:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 18:52:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:52:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:52:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:52:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:52:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:52:56 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-01-15 18:53:05 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 18:53:26 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-15 18:53:46 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 18:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:53:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:53:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:53:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:53:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:53:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:53:56 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-01-15 18:54:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 18:54:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 18:54:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 18:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:54:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:54:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:54:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:54:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:54:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:54:56 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-15 18:55:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 18:55:26 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 18:55:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 18:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:55:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 18:55:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:55:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:55:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:55:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:55:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:55:56 [DEBUG   ] Finished updating board flags in 1.455 seconds
2019-01-15 18:56:05 [DEBUG   ] Got command RPT from MCS: ref #1178380
2019-01-15 18:56:05 [DEBUG   ] summary = ERROR
2019-01-15 18:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178380  13 58498 68165089 A  ERRORERROR'
2019-01-15 18:56:05 [DEBUG   ] Got command RPT from MCS: ref #1178381
2019-01-15 18:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178381  77 58498 68165090 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:56:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 18:56:25 [DEBUG   ] Got command RPT from MCS: ref #1178399
2019-01-15 18:56:25 [DEBUG   ] summary = ERROR
2019-01-15 18:56:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178399  13 58498 68185574 A  ERRORERROR'
2019-01-15 18:56:25 [DEBUG   ] Got command RPT from MCS: ref #1178400
2019-01-15 18:56:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:56:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178400  77 58498 68185778 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:56:25 [DEBUG   ] Got command RPT from MCS: ref #1178401
2019-01-15 18:56:25 [DEBUG   ] summary = ERROR
2019-01-15 18:56:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178401  13 58498 68185969 A  ERRORERROR'
2019-01-15 18:56:26 [DEBUG   ] Got command RPT from MCS: ref #1178403
2019-01-15 18:56:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 18:56:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178403  77 58498 68186173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 18:56:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 18:56:26 [DEBUG   ] Got command RPT from MCS: ref #1178404
2019-01-15 18:56:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 18:56:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178404  12 58498 68186377 A  ERRORB–™š'
2019-01-15 18:56:46 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 18:56:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:56:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:56:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:56:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:56:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:56:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:56:56 [DEBUG   ] Finished updating board flags in 1.456 seconds
2019-01-15 18:57:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 18:57:27 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2019-01-15 18:57:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 18:57:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:57:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:57:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:57:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:57:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:57:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:57:56 [DEBUG   ] Finished updating board flags in 1.455 seconds
2019-01-15 18:58:06 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 18:58:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 18:58:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 18:58:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:58:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:58:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:58:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:58:56 [WARNING ] (13, 1, 'bot')
2019-01-15 18:58:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:58:56 [DEBUG   ] Finished updating board flags in 1.471 seconds
2019-01-15 18:59:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 18:59:26 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 18:59:46 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 18:59:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 18:59:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 18:59:57 [WARNING ] (13, 1, 'bot')
2019-01-15 18:59:57 [WARNING ] (13, 1, 'bot')
2019-01-15 18:59:57 [WARNING ] (13, 1, 'bot')
2019-01-15 18:59:57 [WARNING ] (13, 1, 'bot')
2019-01-15 18:59:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 18:59:57 [DEBUG   ] Finished updating board flags in 2.257 seconds
2019-01-15 19:00:06 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 19:00:26 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 19:00:47 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 19:00:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:00:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:00:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:00:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:00:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:00:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:00:57 [DEBUG   ] Finished updating board flags in 2.077 seconds
2019-01-15 19:01:05 [DEBUG   ] Got command RPT from MCS: ref #1178417
2019-01-15 19:01:05 [DEBUG   ] summary = ERROR
2019-01-15 19:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178417  13 58498 68465089 A  ERRORERROR'
2019-01-15 19:01:05 [DEBUG   ] Got command RPT from MCS: ref #1178418
2019-01-15 19:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178418  77 58498 68465090 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:01:07 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 19:01:25 [DEBUG   ] Got command RPT from MCS: ref #1178434
2019-01-15 19:01:25 [DEBUG   ] summary = ERROR
2019-01-15 19:01:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178434  13 58498 68485657 A  ERRORERROR'
2019-01-15 19:01:25 [DEBUG   ] Got command RPT from MCS: ref #1178435
2019-01-15 19:01:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:01:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178435  77 58498 68485861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:01:26 [DEBUG   ] Got command RPT from MCS: ref #1178436
2019-01-15 19:01:26 [DEBUG   ] summary = ERROR
2019-01-15 19:01:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178436  13 58498 68486053 A  ERRORERROR'
2019-01-15 19:01:26 [DEBUG   ] Got command RPT from MCS: ref #1178437
2019-01-15 19:01:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:01:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178437  77 58498 68486257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:01:26 [DEBUG   ] Got command RPT from MCS: ref #1178438
2019-01-15 19:01:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 19:01:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178438  12 58498 68486461 A  ERRORB•™š'
2019-01-15 19:01:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 19:01:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 19:01:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:01:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:01:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:01:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:01:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:01:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:01:57 [DEBUG   ] Finished updating board flags in 2.021 seconds
2019-01-15 19:02:07 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-01-15 19:02:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 19:02:47 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 19:02:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:02:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:02:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:02:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:02:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:02:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:02:57 [DEBUG   ] Finished updating board flags in 1.983 seconds
2019-01-15 19:03:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 19:03:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 19:03:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 19:03:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:03:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:03:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:03:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:03:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:03:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:03:57 [DEBUG   ] Finished updating board flags in 1.807 seconds
2019-01-15 19:04:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 19:04:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 19:04:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 19:04:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:04:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:04:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:04:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:04:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:04:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:04:57 [DEBUG   ] Finished updating board flags in 1.789 seconds
2019-01-15 19:05:08 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-15 19:05:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 19:05:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 19:05:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:05:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:05:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:05:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:05:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:05:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:05:57 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-01-15 19:06:05 [DEBUG   ] Got command RPT from MCS: ref #1178447
2019-01-15 19:06:05 [DEBUG   ] summary = ERROR
2019-01-15 19:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178447  13 58498 68765089 A  ERRORERROR'
2019-01-15 19:06:05 [DEBUG   ] Got command RPT from MCS: ref #1178448
2019-01-15 19:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178448  77 58498 68765090 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:06:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 19:06:25 [DEBUG   ] Got command RPT from MCS: ref #1178466
2019-01-15 19:06:25 [DEBUG   ] summary = ERROR
2019-01-15 19:06:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178466  13 58498 68785729 A  ERRORERROR'
2019-01-15 19:06:25 [DEBUG   ] Got command RPT from MCS: ref #1178467
2019-01-15 19:06:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:06:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178467  77 58498 68785933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:06:26 [DEBUG   ] Got command RPT from MCS: ref #1178468
2019-01-15 19:06:26 [DEBUG   ] summary = ERROR
2019-01-15 19:06:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178468  13 58498 68786137 A  ERRORERROR'
2019-01-15 19:06:26 [DEBUG   ] Got command RPT from MCS: ref #1178470
2019-01-15 19:06:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:06:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178470  77 58498 68786341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:06:26 [DEBUG   ] Got command RPT from MCS: ref #1178472
2019-01-15 19:06:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 19:06:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178472  12 58498 68786533 A  ERRORB”™š'
2019-01-15 19:06:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 19:06:48 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 19:06:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:06:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 19:06:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:06:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:06:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:06:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:06:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:06:57 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-01-15 19:07:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 19:07:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 19:07:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 19:07:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:07:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:07:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:07:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:07:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:07:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:07:57 [DEBUG   ] Finished updating board flags in 1.581 seconds
2019-01-15 19:08:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 19:08:28 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 19:08:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 19:08:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:08:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:08:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:08:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:08:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:08:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:08:57 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-01-15 19:09:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 19:09:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 19:09:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 19:09:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:09:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:09:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:09:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:09:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:09:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:09:57 [DEBUG   ] Finished updating board flags in 1.419 seconds
2019-01-15 19:10:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 19:10:29 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 19:10:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 19:10:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-15 19:10:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:10:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 19:10:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:10:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:10:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:10:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:10:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:10:57 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-01-15 19:11:05 [DEBUG   ] Got command RPT from MCS: ref #1178480
2019-01-15 19:11:05 [DEBUG   ] summary = ERROR
2019-01-15 19:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178480  13 58498 69065089 A  ERRORERROR'
2019-01-15 19:11:05 [DEBUG   ] Got command RPT from MCS: ref #1178481
2019-01-15 19:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178481  77 58498 69065090 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:11:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 19:11:25 [DEBUG   ] Got command RPT from MCS: ref #1178497
2019-01-15 19:11:25 [DEBUG   ] summary = ERROR
2019-01-15 19:11:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178497  13 58498 69085813 A  ERRORERROR'
2019-01-15 19:11:26 [DEBUG   ] Got command RPT from MCS: ref #1178498
2019-01-15 19:11:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:11:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178498  77 58498 69086017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:11:26 [DEBUG   ] Got command RPT from MCS: ref #1178499
2019-01-15 19:11:26 [DEBUG   ] summary = ERROR
2019-01-15 19:11:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178499  13 58498 69086221 A  ERRORERROR'
2019-01-15 19:11:26 [DEBUG   ] Got command RPT from MCS: ref #1178500
2019-01-15 19:11:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:11:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178500  77 58498 69086414 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:11:26 [DEBUG   ] Got command RPT from MCS: ref #1178501
2019-01-15 19:11:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 19:11:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178501  12 58498 69086617 A  ERRORB•™š'
2019-01-15 19:11:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 19:11:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 19:11:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:11:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-15 19:11:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:11:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:11:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:11:57 [WARNING ] (13, 1, 'bot')
2019-01-15 19:11:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:11:57 [DEBUG   ] Finished updating board flags in 1.380 seconds
2019-01-15 19:12:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 19:12:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 19:12:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 19:12:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 19:12:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:12:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:12:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:12:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:12:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:12:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:12:58 [DEBUG   ] Finished updating board flags in 2.213 seconds
2019-01-15 19:13:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 19:13:29 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 19:13:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 19:13:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:13:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:13:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:13:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:13:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:13:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:13:58 [DEBUG   ] Finished updating board flags in 2.184 seconds
2019-01-15 19:14:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 19:14:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 19:14:49 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 19:14:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 19:14:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:14:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:14:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:14:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:14:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:14:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:14:58 [DEBUG   ] Finished updating board flags in 2.002 seconds
2019-01-15 19:15:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 19:15:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 19:15:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 19:15:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:15:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 19:15:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:15:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:15:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:15:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:15:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:15:58 [DEBUG   ] Finished updating board flags in 2.014 seconds
2019-01-15 19:16:05 [DEBUG   ] Got command RPT from MCS: ref #1178510
2019-01-15 19:16:05 [DEBUG   ] summary = ERROR
2019-01-15 19:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178510  13 58498 69365093 A  ERRORERROR'
2019-01-15 19:16:05 [DEBUG   ] Got command RPT from MCS: ref #1178511
2019-01-15 19:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178511  77 58498 69365094 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:16:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 19:16:25 [DEBUG   ] Got command RPT from MCS: ref #1178529
2019-01-15 19:16:25 [DEBUG   ] summary = ERROR
2019-01-15 19:16:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178529  13 58498 69385901 A  ERRORERROR'
2019-01-15 19:16:26 [DEBUG   ] Got command RPT from MCS: ref #1178530
2019-01-15 19:16:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:16:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178530  77 58498 69386093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:16:26 [DEBUG   ] Got command RPT from MCS: ref #1178531
2019-01-15 19:16:26 [DEBUG   ] summary = ERROR
2019-01-15 19:16:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178531  13 58498 69386297 A  ERRORERROR'
2019-01-15 19:16:26 [DEBUG   ] Got command RPT from MCS: ref #1178533
2019-01-15 19:16:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:16:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178533  77 58498 69386501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:16:26 [DEBUG   ] Got command RPT from MCS: ref #1178534
2019-01-15 19:16:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 19:16:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178534  12 58498 69386693 A  ERRORB—™š'
2019-01-15 19:16:30 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-15 19:16:49 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 19:16:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:16:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:16:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:16:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:16:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:16:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:16:58 [DEBUG   ] Finished updating board flags in 1.982 seconds
2019-01-15 19:17:10 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-15 19:17:30 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 19:17:50 [DEBUG   ] Finished updating ant stats in 1.184 seconds
2019-01-15 19:17:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:17:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 19:17:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:17:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:17:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:17:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:17:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:17:58 [DEBUG   ] Finished updating board flags in 1.822 seconds
2019-01-15 19:18:10 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 19:18:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 19:18:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 19:18:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:18:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:18:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:18:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:18:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:18:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:18:58 [DEBUG   ] Finished updating board flags in 1.783 seconds
2019-01-15 19:19:10 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 19:19:30 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 19:19:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 19:19:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:19:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 19:19:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:19:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:19:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:19:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:19:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:19:58 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-01-15 19:20:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 19:20:30 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 19:20:50 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 19:20:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:20:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:20:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:20:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:20:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:20:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:20:58 [DEBUG   ] Finished updating board flags in 1.603 seconds
2019-01-15 19:21:05 [DEBUG   ] Got command RPT from MCS: ref #1178547
2019-01-15 19:21:05 [DEBUG   ] summary = ERROR
2019-01-15 19:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178547  13 58498 69665085 A  ERRORERROR'
2019-01-15 19:21:05 [DEBUG   ] Got command RPT from MCS: ref #1178548
2019-01-15 19:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178548  77 58498 69665086 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:21:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 19:21:25 [DEBUG   ] Got command RPT from MCS: ref #1178564
2019-01-15 19:21:25 [DEBUG   ] summary = ERROR
2019-01-15 19:21:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178564  13 58498 69685977 A  ERRORERROR'
2019-01-15 19:21:26 [DEBUG   ] Got command RPT from MCS: ref #1178565
2019-01-15 19:21:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:21:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178565  77 58498 69686181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:21:26 [DEBUG   ] Got command RPT from MCS: ref #1178566
2019-01-15 19:21:26 [DEBUG   ] summary = ERROR
2019-01-15 19:21:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178566  13 58498 69686373 A  ERRORERROR'
2019-01-15 19:21:26 [DEBUG   ] Got command RPT from MCS: ref #1178567
2019-01-15 19:21:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:21:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178567  77 58498 69686577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:21:26 [DEBUG   ] Got command RPT from MCS: ref #1178568
2019-01-15 19:21:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 19:21:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178568  12 58498 69686781 A  ERRORB–™š'
2019-01-15 19:21:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 19:21:50 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 19:21:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:21:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:21:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:21:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:21:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:21:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:21:58 [DEBUG   ] Finished updating board flags in 1.628 seconds
2019-01-15 19:22:10 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 19:22:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 19:22:51 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-15 19:22:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:22:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:22:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:22:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:22:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:22:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:22:58 [DEBUG   ] Finished updating board flags in 1.567 seconds
2019-01-15 19:23:10 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-15 19:23:31 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-15 19:23:51 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 19:23:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:23:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:23:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:23:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:23:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:23:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:23:58 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-01-15 19:24:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 19:24:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 19:24:51 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 19:24:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:24:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:24:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:24:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:24:58 [WARNING ] (13, 1, 'bot')
2019-01-15 19:24:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:24:58 [DEBUG   ] Finished updating board flags in 1.396 seconds
2019-01-15 19:25:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 19:25:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 19:25:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 19:25:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:25:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:25:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:25:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:25:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:25:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:25:59 [DEBUG   ] Finished updating board flags in 2.224 seconds
2019-01-15 19:26:05 [DEBUG   ] Got command RPT from MCS: ref #1178573
2019-01-15 19:26:05 [DEBUG   ] summary = ERROR
2019-01-15 19:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178573  13 58498 69965093 A  ERRORERROR'
2019-01-15 19:26:05 [DEBUG   ] Got command RPT from MCS: ref #1178574
2019-01-15 19:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178574  77 58498 69965094 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:26:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 19:26:26 [DEBUG   ] Got command RPT from MCS: ref #1178592
2019-01-15 19:26:26 [DEBUG   ] summary = ERROR
2019-01-15 19:26:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178592  13 58498 69986057 A  ERRORERROR'
2019-01-15 19:26:26 [DEBUG   ] Got command RPT from MCS: ref #1178593
2019-01-15 19:26:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:26:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178593  77 58498 69986261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:26:26 [DEBUG   ] Got command RPT from MCS: ref #1178594
2019-01-15 19:26:26 [DEBUG   ] summary = ERROR
2019-01-15 19:26:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178594  13 58498 69986453 A  ERRORERROR'
2019-01-15 19:26:26 [DEBUG   ] Got command RPT from MCS: ref #1178596
2019-01-15 19:26:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:26:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178596  77 58498 69986657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:26:26 [DEBUG   ] Got command RPT from MCS: ref #1178597
2019-01-15 19:26:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 19:26:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178597  12 58498 69986861 A  ERRORB•™š'
2019-01-15 19:26:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 19:26:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 19:26:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:26:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:26:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:26:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:26:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:26:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:26:59 [DEBUG   ] Finished updating board flags in 2.181 seconds
2019-01-15 19:27:11 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2019-01-15 19:27:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 19:27:52 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-15 19:27:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:27:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 19:27:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:27:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:27:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:27:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:27:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:27:59 [DEBUG   ] Finished updating board flags in 2.001 seconds
2019-01-15 19:28:12 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 19:28:32 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 19:28:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 19:28:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:28:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:28:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:28:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:28:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:28:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:28:59 [DEBUG   ] Finished updating board flags in 1.990 seconds
2019-01-15 19:29:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 19:29:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 19:29:52 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 19:29:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:29:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:29:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:29:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:29:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:29:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:29:59 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-01-15 19:30:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 19:30:32 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 19:30:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 19:30:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:30:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:30:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:30:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:30:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:30:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:30:59 [DEBUG   ] Finished updating board flags in 1.793 seconds
2019-01-15 19:31:05 [DEBUG   ] Got command RPT from MCS: ref #1178610
2019-01-15 19:31:05 [DEBUG   ] summary = ERROR
2019-01-15 19:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178610  13 58498 70265093 A  ERRORERROR'
2019-01-15 19:31:05 [DEBUG   ] Got command RPT from MCS: ref #1178611
2019-01-15 19:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178611  77 58498 70265094 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:31:12 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 19:31:26 [DEBUG   ] Got command RPT from MCS: ref #1178627
2019-01-15 19:31:26 [DEBUG   ] summary = ERROR
2019-01-15 19:31:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178627  13 58498 70286141 A  ERRORERROR'
2019-01-15 19:31:26 [DEBUG   ] Got command RPT from MCS: ref #1178628
2019-01-15 19:31:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:31:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178628  77 58498 70286352 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:31:26 [DEBUG   ] Got command RPT from MCS: ref #1178629
2019-01-15 19:31:26 [DEBUG   ] summary = ERROR
2019-01-15 19:31:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178629  13 58498 70286541 A  ERRORERROR'
2019-01-15 19:31:26 [DEBUG   ] Got command RPT from MCS: ref #1178630
2019-01-15 19:31:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:31:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178630  77 58498 70286745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:31:26 [DEBUG   ] Got command RPT from MCS: ref #1178631
2019-01-15 19:31:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 19:31:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178631  12 58498 70286937 A  ERRORB”™š'
2019-01-15 19:31:32 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 19:31:53 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 19:31:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:31:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 19:31:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:31:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:31:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:31:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:31:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:31:59 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-01-15 19:32:13 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 19:32:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 19:32:53 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 19:32:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:32:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:32:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:32:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:32:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:32:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:32:59 [DEBUG   ] Finished updating board flags in 1.591 seconds
2019-01-15 19:33:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 19:33:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 19:33:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 19:33:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:33:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:33:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:33:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:33:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:33:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:33:59 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-01-15 19:34:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 19:34:33 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 19:34:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 19:34:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:34:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:34:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:34:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:34:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:34:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:34:59 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-01-15 19:35:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 19:35:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 19:35:53 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 19:35:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:35:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:35:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:35:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:35:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:35:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:35:59 [DEBUG   ] Finished updating board flags in 1.401 seconds
2019-01-15 19:36:05 [DEBUG   ] Got command RPT from MCS: ref #1178640
2019-01-15 19:36:05 [DEBUG   ] summary = ERROR
2019-01-15 19:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178640  13 58498 70565097 A  ERRORERROR'
2019-01-15 19:36:05 [DEBUG   ] Got command RPT from MCS: ref #1178641
2019-01-15 19:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178641  77 58498 70565098 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:36:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 19:36:26 [DEBUG   ] Got command RPT from MCS: ref #1178659
2019-01-15 19:36:26 [DEBUG   ] summary = ERROR
2019-01-15 19:36:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178659  13 58498 70586217 A  ERRORERROR'
2019-01-15 19:36:26 [DEBUG   ] Got command RPT from MCS: ref #1178660
2019-01-15 19:36:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:36:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178660  77 58498 70586421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:36:26 [DEBUG   ] Got command RPT from MCS: ref #1178661
2019-01-15 19:36:26 [DEBUG   ] summary = ERROR
2019-01-15 19:36:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178661  13 58498 70586613 A  ERRORERROR'
2019-01-15 19:36:26 [DEBUG   ] Got command RPT from MCS: ref #1178663
2019-01-15 19:36:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:36:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178663  77 58498 70586817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:36:27 [DEBUG   ] Got command RPT from MCS: ref #1178664
2019-01-15 19:36:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 19:36:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178664  12 58498 70587021 A  ERRORB”™š'
2019-01-15 19:36:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 19:36:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 19:36:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:36:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:36:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:36:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:36:59 [WARNING ] (13, 1, 'bot')
2019-01-15 19:36:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:36:59 [DEBUG   ] Finished updating board flags in 1.320 seconds
2019-01-15 19:37:13 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 19:37:34 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 19:37:54 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 19:37:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:38:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:38:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:38:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:38:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:38:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:38:00 [DEBUG   ] Finished updating board flags in 2.094 seconds
2019-01-15 19:38:14 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 19:38:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 19:38:54 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 19:38:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:39:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:39:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:39:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:39:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:39:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:39:00 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-01-15 19:39:14 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 19:39:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 19:39:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 19:39:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:39:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-15 19:40:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:40:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:40:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:40:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:40:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:40:00 [DEBUG   ] Finished updating board flags in 1.820 seconds
2019-01-15 19:40:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 19:40:34 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 19:40:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 19:40:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:41:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:41:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:41:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:41:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:41:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:41:00 [DEBUG   ] Finished updating board flags in 1.790 seconds
2019-01-15 19:41:05 [DEBUG   ] Got command RPT from MCS: ref #1178673
2019-01-15 19:41:05 [DEBUG   ] summary = ERROR
2019-01-15 19:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178673  13 58498 70865093 A  ERRORERROR'
2019-01-15 19:41:05 [DEBUG   ] Got command RPT from MCS: ref #1178674
2019-01-15 19:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178674  77 58498 70865094 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:41:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 19:41:26 [DEBUG   ] Got command RPT from MCS: ref #1178690
2019-01-15 19:41:26 [DEBUG   ] summary = ERROR
2019-01-15 19:41:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178690  13 58498 70886301 A  ERRORERROR'
2019-01-15 19:41:26 [DEBUG   ] Got command RPT from MCS: ref #1178691
2019-01-15 19:41:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:41:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178691  77 58498 70886493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:41:26 [DEBUG   ] Got command RPT from MCS: ref #1178692
2019-01-15 19:41:26 [DEBUG   ] summary = ERROR
2019-01-15 19:41:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178692  13 58498 70886697 A  ERRORERROR'
2019-01-15 19:41:26 [DEBUG   ] Got command RPT from MCS: ref #1178693
2019-01-15 19:41:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:41:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178693  77 58498 70886901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:41:27 [DEBUG   ] Got command RPT from MCS: ref #1178694
2019-01-15 19:41:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 19:41:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178694  12 58498 70887105 A  ERRORB–™š'
2019-01-15 19:41:34 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 19:41:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 19:41:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:42:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:42:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:42:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:42:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:42:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:42:00 [DEBUG   ] Finished updating board flags in 1.671 seconds
2019-01-15 19:42:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 19:42:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 19:42:54 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 19:42:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:43:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:43:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:43:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:43:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:43:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:43:00 [DEBUG   ] Finished updating board flags in 1.532 seconds
2019-01-15 19:43:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 19:43:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 19:43:55 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-15 19:43:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:44:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-15 19:44:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:44:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:44:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:44:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:44:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:44:00 [DEBUG   ] Finished updating board flags in 1.407 seconds
2019-01-15 19:44:15 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 19:44:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 19:44:55 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 19:44:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:45:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 19:45:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-15 19:45:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:45:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:45:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:45:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:45:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:45:00 [DEBUG   ] Finished updating board flags in 1.401 seconds
2019-01-15 19:45:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 19:45:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 19:45:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 19:45:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:46:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:46:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:46:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:46:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:46:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:46:00 [DEBUG   ] Finished updating board flags in 1.406 seconds
2019-01-15 19:46:05 [DEBUG   ] Got command RPT from MCS: ref #1178703
2019-01-15 19:46:05 [DEBUG   ] summary = ERROR
2019-01-15 19:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178703  13 58498 71165089 A  ERRORERROR'
2019-01-15 19:46:05 [DEBUG   ] Got command RPT from MCS: ref #1178704
2019-01-15 19:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178704  77 58498 71165090 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:46:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 19:46:26 [DEBUG   ] Got command RPT from MCS: ref #1178722
2019-01-15 19:46:26 [DEBUG   ] summary = ERROR
2019-01-15 19:46:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178722  13 58498 71186377 A  ERRORERROR'
2019-01-15 19:46:26 [DEBUG   ] Got command RPT from MCS: ref #1178723
2019-01-15 19:46:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:46:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178723  77 58498 71186581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:46:26 [DEBUG   ] Got command RPT from MCS: ref #1178724
2019-01-15 19:46:26 [DEBUG   ] summary = ERROR
2019-01-15 19:46:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178724  13 58498 71186773 A  ERRORERROR'
2019-01-15 19:46:26 [DEBUG   ] Got command RPT from MCS: ref #1178726
2019-01-15 19:46:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:46:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178726  77 58498 71186977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:46:27 [DEBUG   ] Got command RPT from MCS: ref #1178727
2019-01-15 19:46:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 19:46:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178727  12 58498 71187181 A  ERRORB—™š'
2019-01-15 19:46:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 19:46:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 19:46:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:47:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:47:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:47:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:47:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:47:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:47:00 [DEBUG   ] Finished updating board flags in 1.393 seconds
2019-01-15 19:47:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 19:47:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 19:47:55 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 19:48:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:48:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:48:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:48:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:48:00 [WARNING ] (13, 1, 'bot')
2019-01-15 19:48:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:48:00 [DEBUG   ] Finished updating board flags in 1.353 seconds
2019-01-15 19:48:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 19:48:35 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 19:48:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 19:49:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:49:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:49:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:49:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:49:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:49:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:49:01 [DEBUG   ] Finished updating board flags in 2.060 seconds
2019-01-15 19:49:15 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 19:49:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 19:49:55 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 19:50:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:50:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 19:50:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:50:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:50:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:50:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:50:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:50:01 [DEBUG   ] Finished updating board flags in 1.990 seconds
2019-01-15 19:50:16 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 19:50:36 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 19:50:56 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 19:51:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:51:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:51:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:51:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:51:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:51:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:51:01 [DEBUG   ] Finished updating board flags in 1.823 seconds
2019-01-15 19:51:05 [DEBUG   ] Got command RPT from MCS: ref #1178740
2019-01-15 19:51:05 [DEBUG   ] summary = ERROR
2019-01-15 19:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178740  13 58498 71465093 A  ERRORERROR'
2019-01-15 19:51:05 [DEBUG   ] Got command RPT from MCS: ref #1178741
2019-01-15 19:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178741  77 58498 71465094 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:51:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 19:51:26 [DEBUG   ] Got command RPT from MCS: ref #1178757
2019-01-15 19:51:26 [DEBUG   ] summary = ERROR
2019-01-15 19:51:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178757  13 58498 71486461 A  ERRORERROR'
2019-01-15 19:51:26 [DEBUG   ] Got command RPT from MCS: ref #1178758
2019-01-15 19:51:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:51:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178758  77 58498 71486653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:51:26 [DEBUG   ] Got command RPT from MCS: ref #1178759
2019-01-15 19:51:26 [DEBUG   ] summary = ERROR
2019-01-15 19:51:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178759  13 58498 71486872 A  ERRORERROR'
2019-01-15 19:51:27 [DEBUG   ] Got command RPT from MCS: ref #1178760
2019-01-15 19:51:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:51:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178760  77 58498 71487061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:51:27 [DEBUG   ] Got command RPT from MCS: ref #1178761
2019-01-15 19:51:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 19:51:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178761  12 58498 71487265 A  ERRORB–™š'
2019-01-15 19:51:36 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 19:51:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 19:52:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:52:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:52:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:52:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:52:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:52:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:52:01 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-01-15 19:52:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 19:52:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 19:52:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 19:53:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:53:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:53:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:53:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:53:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:53:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:53:01 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-15 19:53:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 19:53:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 19:53:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 19:54:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:54:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:54:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:54:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:54:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:54:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:54:01 [DEBUG   ] Finished updating board flags in 1.594 seconds
2019-01-15 19:54:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 19:54:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 19:54:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 19:55:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:55:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:55:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:55:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:55:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:55:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:55:01 [DEBUG   ] Finished updating board flags in 1.422 seconds
2019-01-15 19:55:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 19:55:37 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 19:55:57 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 19:56:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:56:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:56:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:56:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:56:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:56:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:56:01 [DEBUG   ] Finished updating board flags in 1.380 seconds
2019-01-15 19:56:05 [DEBUG   ] Got command RPT from MCS: ref #1178766
2019-01-15 19:56:05 [DEBUG   ] summary = ERROR
2019-01-15 19:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178766  13 58498 71765101 A  ERRORERROR'
2019-01-15 19:56:05 [DEBUG   ] Got command RPT from MCS: ref #1178767
2019-01-15 19:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178767  77 58498 71765102 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:56:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 19:56:26 [DEBUG   ] Got command RPT from MCS: ref #1178785
2019-01-15 19:56:26 [DEBUG   ] summary = ERROR
2019-01-15 19:56:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178785  13 58498 71786533 A  ERRORERROR'
2019-01-15 19:56:26 [DEBUG   ] Got command RPT from MCS: ref #1178786
2019-01-15 19:56:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:56:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178786  77 58498 71786737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:56:26 [DEBUG   ] Got command RPT from MCS: ref #1178787
2019-01-15 19:56:26 [DEBUG   ] summary = ERROR
2019-01-15 19:56:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178787  13 58498 71786941 A  ERRORERROR'
2019-01-15 19:56:27 [DEBUG   ] Got command RPT from MCS: ref #1178789
2019-01-15 19:56:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 19:56:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178789  77 58498 71787145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 19:56:27 [DEBUG   ] Got command RPT from MCS: ref #1178790
2019-01-15 19:56:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 19:56:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178790  12 58498 71787337 A  ERRORB–™š'
2019-01-15 19:56:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 19:56:57 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 19:57:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:57:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:57:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:57:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:57:01 [WARNING ] (13, 1, 'bot')
2019-01-15 19:57:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:57:01 [DEBUG   ] Finished updating board flags in 1.358 seconds
2019-01-15 19:57:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 19:57:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 19:57:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 19:58:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:58:02 [WARNING ] (13, 1, 'bot')
2019-01-15 19:58:02 [WARNING ] (13, 1, 'bot')
2019-01-15 19:58:02 [WARNING ] (13, 1, 'bot')
2019-01-15 19:58:02 [WARNING ] (13, 1, 'bot')
2019-01-15 19:58:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:58:02 [DEBUG   ] Finished updating board flags in 2.058 seconds
2019-01-15 19:58:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 19:58:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 19:58:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 19:59:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 19:59:02 [WARNING ] (13, 1, 'bot')
2019-01-15 19:59:02 [WARNING ] (13, 1, 'bot')
2019-01-15 19:59:02 [WARNING ] (13, 1, 'bot')
2019-01-15 19:59:02 [WARNING ] (13, 1, 'bot')
2019-01-15 19:59:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 19:59:02 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-01-15 19:59:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 19:59:37 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 19:59:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 20:00:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:00:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:00:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:00:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:00:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:00:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:00:02 [DEBUG   ] Finished updating board flags in 1.823 seconds
2019-01-15 20:00:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 20:00:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 20:00:57 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 20:01:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:01:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:01:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:01:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:01:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:01:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:01:02 [DEBUG   ] Finished updating board flags in 1.829 seconds
2019-01-15 20:01:05 [DEBUG   ] Got command RPT from MCS: ref #1178803
2019-01-15 20:01:05 [DEBUG   ] summary = ERROR
2019-01-15 20:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178803  13 58498 72065093 A  ERRORERROR'
2019-01-15 20:01:05 [DEBUG   ] Got command RPT from MCS: ref #1178804
2019-01-15 20:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178804  77 58498 72065094 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:01:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 20:01:26 [DEBUG   ] Got command RPT from MCS: ref #1178820
2019-01-15 20:01:26 [DEBUG   ] summary = ERROR
2019-01-15 20:01:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178820  13 58498 72086613 A  ERRORERROR'
2019-01-15 20:01:26 [DEBUG   ] Got command RPT from MCS: ref #1178821
2019-01-15 20:01:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:01:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178821  77 58498 72086817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:01:27 [DEBUG   ] Got command RPT from MCS: ref #1178822
2019-01-15 20:01:27 [DEBUG   ] summary = ERROR
2019-01-15 20:01:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178822  13 58498 72087021 A  ERRORERROR'
2019-01-15 20:01:27 [DEBUG   ] Got command RPT from MCS: ref #1178823
2019-01-15 20:01:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:01:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178823  77 58498 72087225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:01:27 [DEBUG   ] Got command RPT from MCS: ref #1178824
2019-01-15 20:01:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 20:01:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178824  12 58498 72087417 A  ERRORB”™š'
2019-01-15 20:01:37 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 20:01:58 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 20:02:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:02:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:02:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:02:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:02:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:02:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:02:02 [DEBUG   ] Finished updating board flags in 1.746 seconds
2019-01-15 20:02:18 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 20:02:38 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 20:02:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 20:03:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:03:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:03:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:03:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:03:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:03:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:03:02 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-01-15 20:03:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 20:03:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 20:03:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 20:04:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:04:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:04:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:04:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:04:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:04:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:04:02 [DEBUG   ] Finished updating board flags in 1.586 seconds
2019-01-15 20:04:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 20:04:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 20:04:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 20:05:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:05:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:05:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:05:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:05:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:05:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:05:02 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-01-15 20:05:18 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 20:05:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 20:05:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 20:06:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:06:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:06:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:06:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:06:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:06:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:06:02 [DEBUG   ] Finished updating board flags in 1.387 seconds
2019-01-15 20:06:05 [DEBUG   ] Got command RPT from MCS: ref #1178833
2019-01-15 20:06:05 [DEBUG   ] summary = ERROR
2019-01-15 20:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178833  13 58498 72365105 A  ERRORERROR'
2019-01-15 20:06:05 [DEBUG   ] Got command RPT from MCS: ref #1178834
2019-01-15 20:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178834  77 58498 72365106 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:06:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 20:06:26 [DEBUG   ] Got command RPT from MCS: ref #1178852
2019-01-15 20:06:26 [DEBUG   ] summary = ERROR
2019-01-15 20:06:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178852  13 58498 72386693 A  ERRORERROR'
2019-01-15 20:06:26 [DEBUG   ] Got command RPT from MCS: ref #1178853
2019-01-15 20:06:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:06:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178853  77 58498 72386897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:06:27 [DEBUG   ] Got command RPT from MCS: ref #1178854
2019-01-15 20:06:27 [DEBUG   ] summary = ERROR
2019-01-15 20:06:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178854  13 58498 72387101 A  ERRORERROR'
2019-01-15 20:06:27 [DEBUG   ] Got command RPT from MCS: ref #1178856
2019-01-15 20:06:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:06:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178856  77 58498 72387305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:06:27 [DEBUG   ] Got command RPT from MCS: ref #1178857
2019-01-15 20:06:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 20:06:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178857  12 58498 72387497 A  ERRORB”™š'
2019-01-15 20:06:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 20:06:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 20:07:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:07:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 20:07:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:07:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:07:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:07:02 [WARNING ] (13, 1, 'bot')
2019-01-15 20:07:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:07:02 [DEBUG   ] Finished updating board flags in 1.400 seconds
2019-01-15 20:07:19 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 20:07:39 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 20:07:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 20:08:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:08:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:08:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:08:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:08:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:08:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:08:03 [DEBUG   ] Finished updating board flags in 2.010 seconds
2019-01-15 20:08:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 20:08:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 20:08:59 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 20:09:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:09:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:09:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:09:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:09:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:09:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:09:03 [DEBUG   ] Finished updating board flags in 2.011 seconds
2019-01-15 20:09:19 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 20:09:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 20:09:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 20:10:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:10:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:10:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:10:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:10:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:10:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:10:03 [DEBUG   ] Finished updating board flags in 1.988 seconds
2019-01-15 20:10:19 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 20:10:39 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 20:10:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 20:11:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:11:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:11:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:11:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:11:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:11:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:11:03 [DEBUG   ] Finished updating board flags in 1.831 seconds
2019-01-15 20:11:05 [DEBUG   ] Got command RPT from MCS: ref #1178866
2019-01-15 20:11:05 [DEBUG   ] summary = ERROR
2019-01-15 20:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178866  13 58498 72665105 A  ERRORERROR'
2019-01-15 20:11:05 [DEBUG   ] Got command RPT from MCS: ref #1178867
2019-01-15 20:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178867  77 58498 72665106 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:11:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 20:11:26 [DEBUG   ] Got command RPT from MCS: ref #1178883
2019-01-15 20:11:26 [DEBUG   ] summary = ERROR
2019-01-15 20:11:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178883  13 58498 72686777 A  ERRORERROR'
2019-01-15 20:11:26 [DEBUG   ] Got command RPT from MCS: ref #1178884
2019-01-15 20:11:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:11:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178884  77 58498 72686981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:11:27 [DEBUG   ] Got command RPT from MCS: ref #1178885
2019-01-15 20:11:27 [DEBUG   ] summary = ERROR
2019-01-15 20:11:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178885  13 58498 72687185 A  ERRORERROR'
2019-01-15 20:11:27 [DEBUG   ] Got command RPT from MCS: ref #1178886
2019-01-15 20:11:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:11:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178886  77 58498 72687377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:11:27 [DEBUG   ] Got command RPT from MCS: ref #1178887
2019-01-15 20:11:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 20:11:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178887  12 58498 72687581 A  ERRORB”™š'
2019-01-15 20:11:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 20:11:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 20:12:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:12:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:12:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:12:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:12:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:12:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:12:03 [DEBUG   ] Finished updating board flags in 1.780 seconds
2019-01-15 20:12:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 20:12:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 20:13:00 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 20:13:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:13:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:13:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:13:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:13:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:13:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:13:03 [DEBUG   ] Finished updating board flags in 1.610 seconds
2019-01-15 20:13:20 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 20:13:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 20:14:00 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 20:14:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:14:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:14:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:14:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:14:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:14:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:14:03 [DEBUG   ] Finished updating board flags in 1.593 seconds
2019-01-15 20:14:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 20:14:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 20:15:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 20:15:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:15:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:15:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:15:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:15:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:15:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:15:03 [DEBUG   ] Finished updating board flags in 1.405 seconds
2019-01-15 20:15:20 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 20:15:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 20:16:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 20:16:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:16:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 20:16:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:16:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:16:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:16:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:16:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:16:03 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-01-15 20:16:05 [DEBUG   ] Got command RPT from MCS: ref #1178896
2019-01-15 20:16:05 [DEBUG   ] summary = ERROR
2019-01-15 20:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178896  13 58498 72965105 A  ERRORERROR'
2019-01-15 20:16:05 [DEBUG   ] Got command RPT from MCS: ref #1178897
2019-01-15 20:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178897  77 58498 72965106 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:16:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 20:16:26 [DEBUG   ] Got command RPT from MCS: ref #1178915
2019-01-15 20:16:26 [DEBUG   ] summary = ERROR
2019-01-15 20:16:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178915  13 58498 72986861 A  ERRORERROR'
2019-01-15 20:16:27 [DEBUG   ] Got command RPT from MCS: ref #1178916
2019-01-15 20:16:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:16:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178916  77 58498 72987053 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:16:27 [DEBUG   ] Got command RPT from MCS: ref #1178917
2019-01-15 20:16:27 [DEBUG   ] summary = ERROR
2019-01-15 20:16:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178917  13 58498 72987257 A  ERRORERROR'
2019-01-15 20:16:27 [DEBUG   ] Got command RPT from MCS: ref #1178919
2019-01-15 20:16:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:16:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178919  77 58498 72987461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:16:27 [DEBUG   ] Got command RPT from MCS: ref #1178920
2019-01-15 20:16:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 20:16:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178920  12 58498 72987665 A  ERRORB—™š'
2019-01-15 20:16:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 20:17:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 20:17:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:17:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:17:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:17:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:17:03 [WARNING ] (13, 1, 'bot')
2019-01-15 20:17:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:17:03 [DEBUG   ] Finished updating board flags in 1.359 seconds
2019-01-15 20:17:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 20:17:41 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 20:18:01 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 20:18:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 20:18:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:18:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 20:18:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:18:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:18:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:18:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:18:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:18:04 [DEBUG   ] Finished updating board flags in 2.072 seconds
2019-01-15 20:18:21 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 20:18:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 20:19:01 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 20:19:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:19:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:19:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:19:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:19:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:19:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:19:04 [DEBUG   ] Finished updating board flags in 1.992 seconds
2019-01-15 20:19:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 20:19:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 20:20:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 20:20:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:20:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:20:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:20:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:20:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:20:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:20:04 [DEBUG   ] Finished updating board flags in 1.789 seconds
2019-01-15 20:20:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 20:20:41 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 20:21:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 20:21:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:21:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 20:21:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:21:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:21:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:21:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:21:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:21:04 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-01-15 20:21:05 [DEBUG   ] Got command RPT from MCS: ref #1178933
2019-01-15 20:21:05 [DEBUG   ] summary = ERROR
2019-01-15 20:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178933  13 58498 73265101 A  ERRORERROR'
2019-01-15 20:21:05 [DEBUG   ] Got command RPT from MCS: ref #1178934
2019-01-15 20:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178934  77 58498 73265102 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:21:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 20:21:26 [DEBUG   ] Got command RPT from MCS: ref #1178950
2019-01-15 20:21:26 [DEBUG   ] summary = ERROR
2019-01-15 20:21:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178950  13 58498 73286941 A  ERRORERROR'
2019-01-15 20:21:27 [DEBUG   ] Got command RPT from MCS: ref #1178951
2019-01-15 20:21:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:21:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178951  77 58498 73287133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:21:27 [DEBUG   ] Got command RPT from MCS: ref #1178952
2019-01-15 20:21:27 [DEBUG   ] summary = ERROR
2019-01-15 20:21:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178952  13 58498 73287337 A  ERRORERROR'
2019-01-15 20:21:27 [DEBUG   ] Got command RPT from MCS: ref #1178953
2019-01-15 20:21:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:21:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178953  77 58498 73287541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:21:27 [DEBUG   ] Got command RPT from MCS: ref #1178954
2019-01-15 20:21:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 20:21:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178954  12 58498 73287745 A  ERRORB—™š'
2019-01-15 20:21:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 20:22:01 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 20:22:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:22:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:22:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:22:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:22:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:22:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:22:04 [DEBUG   ] Finished updating board flags in 1.630 seconds
2019-01-15 20:22:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 20:22:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 20:23:01 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 20:23:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:23:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:23:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:23:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:23:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:23:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:23:04 [DEBUG   ] Finished updating board flags in 1.569 seconds
2019-01-15 20:23:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 20:23:42 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-15 20:24:02 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 20:24:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:24:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:24:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:24:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:24:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:24:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:24:04 [DEBUG   ] Finished updating board flags in 1.398 seconds
2019-01-15 20:24:22 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 20:24:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 20:25:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 20:25:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:25:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:25:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:25:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:25:04 [WARNING ] (13, 1, 'bot')
2019-01-15 20:25:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:25:04 [DEBUG   ] Finished updating board flags in 1.369 seconds
2019-01-15 20:25:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 20:25:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 20:26:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 20:26:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:26:05 [DEBUG   ] Got command RPT from MCS: ref #1178959
2019-01-15 20:26:05 [DEBUG   ] summary = ERROR
2019-01-15 20:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178959  13 58498 73565098 A  ERRORERROR'
2019-01-15 20:26:05 [DEBUG   ] Got command RPT from MCS: ref #1178960
2019-01-15 20:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178960  77 58498 73565098 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:26:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:26:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:26:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:26:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:26:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:26:05 [DEBUG   ] Finished updating board flags in 2.043 seconds
2019-01-15 20:26:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 20:26:27 [DEBUG   ] Got command RPT from MCS: ref #1178978
2019-01-15 20:26:27 [DEBUG   ] summary = ERROR
2019-01-15 20:26:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178978  13 58498 73587021 A  ERRORERROR'
2019-01-15 20:26:27 [DEBUG   ] Got command RPT from MCS: ref #1178979
2019-01-15 20:26:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:26:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178979  77 58498 73587225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:26:27 [DEBUG   ] Got command RPT from MCS: ref #1178980
2019-01-15 20:26:27 [DEBUG   ] summary = ERROR
2019-01-15 20:26:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178980  13 58498 73587417 A  ERRORERROR'
2019-01-15 20:26:27 [DEBUG   ] Got command RPT from MCS: ref #1178982
2019-01-15 20:26:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:26:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178982  77 58498 73587621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:26:27 [DEBUG   ] Got command RPT from MCS: ref #1178983
2019-01-15 20:26:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 20:26:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178983  12 58498 73587835 A  ERRORB–™š'
2019-01-15 20:26:42 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 20:27:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 20:27:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:27:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:27:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:27:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:27:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:27:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:27:05 [DEBUG   ] Finished updating board flags in 1.985 seconds
2019-01-15 20:27:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 20:27:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 20:28:02 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 20:28:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:28:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:28:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:28:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:28:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:28:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:28:05 [DEBUG   ] Finished updating board flags in 1.808 seconds
2019-01-15 20:28:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 20:28:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 20:29:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 20:29:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:29:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:29:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:29:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:29:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:29:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:29:05 [DEBUG   ] Finished updating board flags in 1.805 seconds
2019-01-15 20:29:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 20:29:43 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-15 20:30:03 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-15 20:30:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:30:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:30:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:30:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:30:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:30:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:30:05 [DEBUG   ] Finished updating board flags in 1.808 seconds
2019-01-15 20:30:22 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-01-15 20:30:42 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-15 20:31:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 20:31:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:31:05 [DEBUG   ] Got command RPT from MCS: ref #1178996
2019-01-15 20:31:05 [DEBUG   ] summary = ERROR
2019-01-15 20:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178996  13 58498 73865105 A  ERRORERROR'
2019-01-15 20:31:05 [DEBUG   ] Got command RPT from MCS: ref #1178997
2019-01-15 20:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1178997  77 58498 73865106 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:31:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:31:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:31:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:31:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:31:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:31:05 [DEBUG   ] Finished updating board flags in 1.789 seconds
2019-01-15 20:31:23 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 20:31:27 [DEBUG   ] Got command RPT from MCS: ref #1179013
2019-01-15 20:31:27 [DEBUG   ] summary = ERROR
2019-01-15 20:31:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179013  13 58498 73887101 A  ERRORERROR'
2019-01-15 20:31:27 [DEBUG   ] Got command RPT from MCS: ref #1179014
2019-01-15 20:31:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:31:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179014  77 58498 73887305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:31:27 [DEBUG   ] Got command RPT from MCS: ref #1179015
2019-01-15 20:31:27 [DEBUG   ] summary = ERROR
2019-01-15 20:31:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179015  13 58498 73887497 A  ERRORERROR'
2019-01-15 20:31:27 [DEBUG   ] Got command RPT from MCS: ref #1179016
2019-01-15 20:31:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:31:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179016  77 58498 73887701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:31:27 [DEBUG   ] Got command RPT from MCS: ref #1179017
2019-01-15 20:31:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 20:31:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179017  12 58498 73887905 A  ERRORB•™š'
2019-01-15 20:31:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 20:32:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 20:32:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:32:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:32:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:32:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:32:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:32:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:32:05 [DEBUG   ] Finished updating board flags in 1.611 seconds
2019-01-15 20:32:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 20:32:43 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 20:33:03 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 20:33:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:33:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:33:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:33:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:33:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:33:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:33:05 [DEBUG   ] Finished updating board flags in 1.695 seconds
2019-01-15 20:33:23 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 20:33:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 20:34:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 20:34:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:34:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:34:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:34:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:34:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:34:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:34:05 [DEBUG   ] Finished updating board flags in 1.502 seconds
2019-01-15 20:34:23 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 20:34:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 20:35:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 20:35:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:35:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:35:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:35:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:35:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:35:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:35:05 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-01-15 20:35:23 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 20:35:43 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 20:36:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 20:36:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:36:05 [DEBUG   ] Got command RPT from MCS: ref #1179026
2019-01-15 20:36:05 [DEBUG   ] summary = ERROR
2019-01-15 20:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179026  13 58498 74165109 A  ERRORERROR'
2019-01-15 20:36:05 [DEBUG   ] Got command RPT from MCS: ref #1179027
2019-01-15 20:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179027  77 58498 74165110 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:36:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:36:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:36:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:36:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:36:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:36:05 [DEBUG   ] Finished updating board flags in 1.389 seconds
2019-01-15 20:36:24 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-15 20:36:27 [DEBUG   ] Got command RPT from MCS: ref #1179045
2019-01-15 20:36:27 [DEBUG   ] summary = ERROR
2019-01-15 20:36:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179045  13 58498 74187177 A  ERRORERROR'
2019-01-15 20:36:27 [DEBUG   ] Got command RPT from MCS: ref #1179046
2019-01-15 20:36:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:36:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179046  77 58498 74187381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:36:27 [DEBUG   ] Got command RPT from MCS: ref #1179047
2019-01-15 20:36:27 [DEBUG   ] summary = ERROR
2019-01-15 20:36:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179047  13 58498 74187585 A  ERRORERROR'
2019-01-15 20:36:27 [DEBUG   ] Got command RPT from MCS: ref #1179049
2019-01-15 20:36:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:36:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179049  77 58498 74187777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:36:27 [DEBUG   ] Got command RPT from MCS: ref #1179050
2019-01-15 20:36:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 20:36:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179050  12 58498 74187981 A  ERRORB”™š'
2019-01-15 20:36:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 20:37:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 20:37:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:37:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:37:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:37:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:37:05 [WARNING ] (13, 1, 'bot')
2019-01-15 20:37:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:37:05 [DEBUG   ] Finished updating board flags in 1.393 seconds
2019-01-15 20:37:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 20:37:44 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 20:38:04 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 20:38:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:38:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:38:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:38:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:38:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:38:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:38:06 [DEBUG   ] Finished updating board flags in 2.021 seconds
2019-01-15 20:38:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 20:38:44 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 20:39:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 20:39:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:39:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 20:39:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:39:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:39:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:39:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:39:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:39:06 [DEBUG   ] Finished updating board flags in 1.983 seconds
2019-01-15 20:39:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 20:39:44 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 20:40:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 20:40:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 20:40:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-15 20:40:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:40:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:40:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:40:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:40:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:40:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:40:06 [DEBUG   ] Finished updating board flags in 1.823 seconds
2019-01-15 20:40:24 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 20:40:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 20:41:05 [DEBUG   ] Got command RPT from MCS: ref #1179059
2019-01-15 20:41:05 [DEBUG   ] summary = ERROR
2019-01-15 20:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179059  13 58498 74465109 A  ERRORERROR'
2019-01-15 20:41:05 [DEBUG   ] Got command RPT from MCS: ref #1179060
2019-01-15 20:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179060  77 58498 74465110 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:41:05 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 20:41:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-15 20:41:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:41:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:41:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:41:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:41:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:41:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:41:06 [DEBUG   ] Finished updating board flags in 1.801 seconds
2019-01-15 20:41:25 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 20:41:27 [DEBUG   ] Got command RPT from MCS: ref #1179076
2019-01-15 20:41:27 [DEBUG   ] summary = ERROR
2019-01-15 20:41:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179076  13 58498 74487266 A  ERRORERROR'
2019-01-15 20:41:27 [DEBUG   ] Got command RPT from MCS: ref #1179077
2019-01-15 20:41:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:41:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179077  77 58498 74487457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:41:27 [DEBUG   ] Got command RPT from MCS: ref #1179078
2019-01-15 20:41:27 [DEBUG   ] summary = ERROR
2019-01-15 20:41:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179078  13 58498 74487661 A  ERRORERROR'
2019-01-15 20:41:27 [DEBUG   ] Got command RPT from MCS: ref #1179079
2019-01-15 20:41:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:41:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179079  77 58498 74487865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:41:28 [DEBUG   ] Got command RPT from MCS: ref #1179080
2019-01-15 20:41:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 20:41:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179080  12 58498 74488070 A  ERRORB–™š'
2019-01-15 20:41:45 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 20:42:05 [DEBUG   ] Finished updating ant stats in 1.049 seconds
2019-01-15 20:42:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:42:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:42:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:42:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:42:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:42:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:42:06 [DEBUG   ] Finished updating board flags in 1.803 seconds
2019-01-15 20:42:25 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2019-01-15 20:42:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 20:43:05 [DEBUG   ] Finished updating ant stats in 0.844 seconds
2019-01-15 20:43:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:43:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:43:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:43:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:43:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:43:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:43:06 [DEBUG   ] Finished updating board flags in 1.796 seconds
2019-01-15 20:43:25 [DEBUG   ] Finished updating ant stats in 0.755 seconds
2019-01-15 20:43:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 20:44:05 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2019-01-15 20:44:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:44:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:44:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:44:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:44:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:44:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:44:06 [DEBUG   ] Finished updating board flags in 1.603 seconds
2019-01-15 20:44:25 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2019-01-15 20:44:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 20:45:05 [DEBUG   ] Finished updating ant stats in 0.451 seconds
2019-01-15 20:45:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:45:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 20:45:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:45:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:45:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:45:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:45:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:45:06 [DEBUG   ] Finished updating board flags in 1.596 seconds
2019-01-15 20:45:26 [DEBUG   ] Finished updating ant stats in 1.354 seconds
2019-01-15 20:45:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 20:46:05 [DEBUG   ] Got command RPT from MCS: ref #1179089
2019-01-15 20:46:05 [DEBUG   ] summary = ERROR
2019-01-15 20:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179089  13 58498 74765113 A  ERRORERROR'
2019-01-15 20:46:05 [DEBUG   ] Got command RPT from MCS: ref #1179090
2019-01-15 20:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179090  77 58498 74765114 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:46:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:46:06 [DEBUG   ] Finished updating ant stats in 1.245 seconds
2019-01-15 20:46:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:46:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:46:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:46:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:46:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:46:06 [DEBUG   ] Finished updating board flags in 1.471 seconds
2019-01-15 20:46:26 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2019-01-15 20:46:27 [DEBUG   ] Got command RPT from MCS: ref #1179108
2019-01-15 20:46:27 [DEBUG   ] summary = ERROR
2019-01-15 20:46:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179108  13 58498 74787342 A  ERRORERROR'
2019-01-15 20:46:27 [DEBUG   ] Got command RPT from MCS: ref #1179109
2019-01-15 20:46:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:46:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179109  77 58498 74787545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:46:27 [DEBUG   ] Got command RPT from MCS: ref #1179110
2019-01-15 20:46:27 [DEBUG   ] summary = ERROR
2019-01-15 20:46:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179110  13 58498 74787749 A  ERRORERROR'
2019-01-15 20:46:27 [DEBUG   ] Got command RPT from MCS: ref #1179112
2019-01-15 20:46:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:46:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179112  77 58498 74787941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:46:28 [DEBUG   ] Got command RPT from MCS: ref #1179113
2019-01-15 20:46:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 20:46:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179113  12 58498 74788145 A  ERRORB—™š'
2019-01-15 20:46:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 20:47:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:47:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 20:47:06 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2019-01-15 20:47:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:47:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:47:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:47:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:47:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:47:06 [DEBUG   ] Finished updating board flags in 1.434 seconds
2019-01-15 20:47:26 [DEBUG   ] Finished updating ant stats in 0.960 seconds
2019-01-15 20:47:46 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 20:48:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:48:06 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2019-01-15 20:48:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:48:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:48:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:48:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:48:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:48:06 [DEBUG   ] Finished updating board flags in 1.473 seconds
2019-01-15 20:48:26 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2019-01-15 20:48:47 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-15 20:49:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:49:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:49:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:49:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:49:06 [WARNING ] (13, 1, 'bot')
2019-01-15 20:49:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:49:06 [DEBUG   ] Finished updating board flags in 1.486 seconds
2019-01-15 20:49:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 20:49:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 20:49:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 20:50:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:50:07 [DEBUG   ] Finished updating ant stats in 1.240 seconds
2019-01-15 20:50:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:50:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:50:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:50:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:50:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:50:07 [DEBUG   ] Finished updating board flags in 2.211 seconds
2019-01-15 20:50:27 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2019-01-15 20:50:47 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 20:51:05 [DEBUG   ] Got command RPT from MCS: ref #1179126
2019-01-15 20:51:05 [DEBUG   ] summary = ERROR
2019-01-15 20:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179126  13 58498 75065113 A  ERRORERROR'
2019-01-15 20:51:05 [DEBUG   ] Got command RPT from MCS: ref #1179127
2019-01-15 20:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179127  77 58498 75065114 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:51:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:51:07 [DEBUG   ] Finished updating ant stats in 1.043 seconds
2019-01-15 20:51:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:51:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:51:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:51:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:51:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:51:07 [DEBUG   ] Finished updating board flags in 2.169 seconds
2019-01-15 20:51:27 [DEBUG   ] Finished updating ant stats in 0.960 seconds
2019-01-15 20:51:27 [DEBUG   ] Got command RPT from MCS: ref #1179143
2019-01-15 20:51:27 [DEBUG   ] summary = ERROR
2019-01-15 20:51:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179143  13 58498 75087425 A  ERRORERROR'
2019-01-15 20:51:27 [DEBUG   ] Got command RPT from MCS: ref #1179144
2019-01-15 20:51:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:51:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179144  77 58498 75087629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:51:27 [DEBUG   ] Got command RPT from MCS: ref #1179145
2019-01-15 20:51:27 [DEBUG   ] summary = ERROR
2019-01-15 20:51:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179145  13 58498 75087821 A  ERRORERROR'
2019-01-15 20:51:28 [DEBUG   ] Got command RPT from MCS: ref #1179146
2019-01-15 20:51:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:51:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179146  77 58498 75088025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:51:28 [DEBUG   ] Got command RPT from MCS: ref #1179147
2019-01-15 20:51:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 20:51:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179147  12 58498 75088229 A  ERRORB–™š'
2019-01-15 20:51:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 20:52:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:52:07 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2019-01-15 20:52:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:52:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:52:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:52:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:52:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:52:07 [DEBUG   ] Finished updating board flags in 2.030 seconds
2019-01-15 20:52:27 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2019-01-15 20:52:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 20:53:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:53:07 [DEBUG   ] Finished updating ant stats in 0.642 seconds
2019-01-15 20:53:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:53:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:53:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:53:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:53:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:53:07 [DEBUG   ] Finished updating board flags in 2.009 seconds
2019-01-15 20:53:27 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2019-01-15 20:53:48 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 20:54:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:54:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:54:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:54:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:54:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:54:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:54:07 [DEBUG   ] Finished updating board flags in 1.971 seconds
2019-01-15 20:54:08 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 20:54:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 20:54:48 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 20:55:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:55:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:55:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:55:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:55:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:55:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:55:07 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-01-15 20:55:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 20:55:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 20:55:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 20:56:05 [DEBUG   ] Got command RPT from MCS: ref #1179152
2019-01-15 20:56:05 [DEBUG   ] summary = ERROR
2019-01-15 20:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179152  13 58498 75365109 A  ERRORERROR'
2019-01-15 20:56:05 [DEBUG   ] Got command RPT from MCS: ref #1179153
2019-01-15 20:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179153  77 58498 75365110 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:56:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:56:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 20:56:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:56:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:56:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:56:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:56:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:56:07 [DEBUG   ] Finished updating board flags in 1.782 seconds
2019-01-15 20:56:08 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 20:56:27 [DEBUG   ] Got command RPT from MCS: ref #1179171
2019-01-15 20:56:27 [DEBUG   ] summary = ERROR
2019-01-15 20:56:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179171  13 58498 75387497 A  ERRORERROR'
2019-01-15 20:56:27 [DEBUG   ] Got command RPT from MCS: ref #1179172
2019-01-15 20:56:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:56:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179172  77 58498 75387701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:56:27 [DEBUG   ] Got command RPT from MCS: ref #1179173
2019-01-15 20:56:27 [DEBUG   ] summary = ERROR
2019-01-15 20:56:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179173  13 58498 75387905 A  ERRORERROR'
2019-01-15 20:56:28 [DEBUG   ] Got command RPT from MCS: ref #1179175
2019-01-15 20:56:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 20:56:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179175  77 58498 75388109 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 20:56:28 [DEBUG   ] Got command RPT from MCS: ref #1179176
2019-01-15 20:56:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 20:56:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179176  12 58498 75388301 A  ERRORB•™š'
2019-01-15 20:56:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 20:56:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 20:57:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:57:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 20:57:08 [WARNING ] (13, 1, 'bot')
2019-01-15 20:57:08 [WARNING ] (13, 1, 'bot')
2019-01-15 20:57:08 [WARNING ] (13, 1, 'bot')
2019-01-15 20:57:08 [WARNING ] (13, 1, 'bot')
2019-01-15 20:57:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:57:08 [DEBUG   ] Finished updating board flags in 2.327 seconds
2019-01-15 20:57:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 20:57:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 20:58:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:58:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:58:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:58:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:58:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:58:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:58:07 [DEBUG   ] Finished updating board flags in 1.469 seconds
2019-01-15 20:58:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 20:58:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 20:58:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 20:59:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 20:59:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 20:59:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:59:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:59:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:59:07 [WARNING ] (13, 1, 'bot')
2019-01-15 20:59:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 20:59:07 [DEBUG   ] Finished updating board flags in 1.367 seconds
2019-01-15 20:59:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 20:59:29 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 20:59:49 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 21:00:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:00:07 [WARNING ] (13, 1, 'bot')
2019-01-15 21:00:07 [WARNING ] (13, 1, 'bot')
2019-01-15 21:00:07 [WARNING ] (13, 1, 'bot')
2019-01-15 21:00:07 [WARNING ] (13, 1, 'bot')
2019-01-15 21:00:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:00:07 [DEBUG   ] Finished updating board flags in 1.378 seconds
2019-01-15 21:00:09 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 21:00:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 21:00:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 21:01:05 [DEBUG   ] Got command RPT from MCS: ref #1179189
2019-01-15 21:01:05 [DEBUG   ] summary = ERROR
2019-01-15 21:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179189  13 58498 75665109 A  ERRORERROR'
2019-01-15 21:01:05 [DEBUG   ] Got command RPT from MCS: ref #1179190
2019-01-15 21:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179190  77 58498 75665110 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:01:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:01:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:01:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:01:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:01:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:01:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:01:08 [DEBUG   ] Finished updating board flags in 2.092 seconds
2019-01-15 21:01:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 21:01:27 [DEBUG   ] Got command RPT from MCS: ref #1179206
2019-01-15 21:01:27 [DEBUG   ] summary = ERROR
2019-01-15 21:01:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179206  13 58498 75687581 A  ERRORERROR'
2019-01-15 21:01:27 [DEBUG   ] Got command RPT from MCS: ref #1179207
2019-01-15 21:01:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:01:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179207  77 58498 75687785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:01:27 [DEBUG   ] Got command RPT from MCS: ref #1179208
2019-01-15 21:01:27 [DEBUG   ] summary = ERROR
2019-01-15 21:01:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179208  13 58498 75687989 A  ERRORERROR'
2019-01-15 21:01:28 [DEBUG   ] Got command RPT from MCS: ref #1179209
2019-01-15 21:01:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:01:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179209  77 58498 75688181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:01:28 [DEBUG   ] Got command RPT from MCS: ref #1179210
2019-01-15 21:01:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 21:01:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179210  12 58498 75688385 A  ERRORB•™š'
2019-01-15 21:01:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 21:01:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 21:02:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:02:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:02:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:02:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:02:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:02:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:02:08 [DEBUG   ] Finished updating board flags in 1.956 seconds
2019-01-15 21:02:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 21:02:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 21:02:49 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 21:03:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:03:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:03:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:03:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:03:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:03:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:03:08 [DEBUG   ] Finished updating board flags in 1.833 seconds
2019-01-15 21:03:09 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 21:03:30 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 21:03:50 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 21:04:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:04:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:04:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:04:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:04:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:04:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:04:08 [DEBUG   ] Finished updating board flags in 1.746 seconds
2019-01-15 21:04:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 21:04:30 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 21:04:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 21:05:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:05:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:05:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:05:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:05:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:05:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:05:08 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-15 21:05:10 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 21:05:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 21:05:50 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 21:06:05 [DEBUG   ] Got command RPT from MCS: ref #1179219
2019-01-15 21:06:05 [DEBUG   ] summary = ERROR
2019-01-15 21:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179219  13 58498 75965109 A  ERRORERROR'
2019-01-15 21:06:05 [DEBUG   ] Got command RPT from MCS: ref #1179220
2019-01-15 21:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179220  77 58498 75965110 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:06:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:06:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:06:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:06:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:06:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:06:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:06:08 [DEBUG   ] Finished updating board flags in 1.599 seconds
2019-01-15 21:06:10 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 21:06:27 [DEBUG   ] Got command RPT from MCS: ref #1179238
2019-01-15 21:06:27 [DEBUG   ] summary = ERROR
2019-01-15 21:06:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179238  13 58498 75987661 A  ERRORERROR'
2019-01-15 21:06:27 [DEBUG   ] Got command RPT from MCS: ref #1179239
2019-01-15 21:06:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:06:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179239  77 58498 75987865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:06:28 [DEBUG   ] Got command RPT from MCS: ref #1179240
2019-01-15 21:06:28 [DEBUG   ] summary = ERROR
2019-01-15 21:06:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179240  13 58498 75988069 A  ERRORERROR'
2019-01-15 21:06:28 [DEBUG   ] Got command RPT from MCS: ref #1179242
2019-01-15 21:06:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:06:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179242  77 58498 75988261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:06:28 [DEBUG   ] Got command RPT from MCS: ref #1179243
2019-01-15 21:06:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 21:06:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179243  12 58498 75988465 A  ERRORB•™š'
2019-01-15 21:06:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 21:06:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 21:07:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:07:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:07:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:07:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:07:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:07:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:07:08 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-01-15 21:07:10 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 21:07:30 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 21:07:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 21:08:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:08:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:08:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:08:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:08:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:08:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:08:08 [DEBUG   ] Finished updating board flags in 1.393 seconds
2019-01-15 21:08:10 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 21:08:31 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-15 21:08:51 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 21:09:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:09:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:09:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:09:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:09:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:09:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:09:09 [DEBUG   ] Finished updating board flags in 2.201 seconds
2019-01-15 21:09:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 21:09:31 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 21:09:51 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 21:10:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:10:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:10:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:10:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:10:08 [WARNING ] (13, 1, 'bot')
2019-01-15 21:10:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:10:08 [DEBUG   ] Finished updating board flags in 1.320 seconds
2019-01-15 21:10:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 21:10:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 21:10:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 21:11:05 [DEBUG   ] Got command RPT from MCS: ref #1179252
2019-01-15 21:11:05 [DEBUG   ] summary = ERROR
2019-01-15 21:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179252  13 58498 76265109 A  ERRORERROR'
2019-01-15 21:11:05 [DEBUG   ] Got command RPT from MCS: ref #1179253
2019-01-15 21:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179253  77 58498 76265110 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:11:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:11:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:11:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:11:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:11:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:11:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:11:09 [DEBUG   ] Finished updating board flags in 2.084 seconds
2019-01-15 21:11:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 21:11:27 [DEBUG   ] Got command RPT from MCS: ref #1179269
2019-01-15 21:11:27 [DEBUG   ] summary = ERROR
2019-01-15 21:11:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179269  13 58498 76287749 A  ERRORERROR'
2019-01-15 21:11:27 [DEBUG   ] Got command RPT from MCS: ref #1179270
2019-01-15 21:11:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:11:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179270  77 58498 76287941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:11:28 [DEBUG   ] Got command RPT from MCS: ref #1179271
2019-01-15 21:11:28 [DEBUG   ] summary = ERROR
2019-01-15 21:11:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179271  13 58498 76288145 A  ERRORERROR'
2019-01-15 21:11:28 [DEBUG   ] Got command RPT from MCS: ref #1179272
2019-01-15 21:11:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:11:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179272  77 58498 76288349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:11:28 [DEBUG   ] Got command RPT from MCS: ref #1179273
2019-01-15 21:11:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 21:11:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179273  12 58498 76288553 A  ERRORB”™š'
2019-01-15 21:11:32 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 21:11:52 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-01-15 21:12:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:12:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 21:12:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:12:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:12:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:12:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:12:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:12:09 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-01-15 21:12:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 21:12:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 21:12:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 21:13:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:13:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:13:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:13:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:13:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:13:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:13:09 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-01-15 21:13:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 21:13:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 21:13:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 21:14:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:14:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:14:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:14:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:14:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:14:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:14:09 [DEBUG   ] Finished updating board flags in 1.795 seconds
2019-01-15 21:14:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 21:14:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 21:14:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 21:15:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:15:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:15:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:15:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:15:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:15:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:15:09 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-01-15 21:15:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 21:15:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 21:15:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 21:16:05 [DEBUG   ] Got command RPT from MCS: ref #1179282
2019-01-15 21:16:05 [DEBUG   ] summary = ERROR
2019-01-15 21:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179282  13 58498 76565117 A  ERRORERROR'
2019-01-15 21:16:05 [DEBUG   ] Got command RPT from MCS: ref #1179283
2019-01-15 21:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179283  77 58498 76565118 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:16:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:16:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:16:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:16:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:16:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:16:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:16:09 [DEBUG   ] Finished updating board flags in 1.588 seconds
2019-01-15 21:16:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 21:16:27 [DEBUG   ] Got command RPT from MCS: ref #1179301
2019-01-15 21:16:27 [DEBUG   ] summary = ERROR
2019-01-15 21:16:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179301  13 58498 76587821 A  ERRORERROR'
2019-01-15 21:16:28 [DEBUG   ] Got command RPT from MCS: ref #1179302
2019-01-15 21:16:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:16:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179302  77 58498 76588025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:16:28 [DEBUG   ] Got command RPT from MCS: ref #1179303
2019-01-15 21:16:28 [DEBUG   ] summary = ERROR
2019-01-15 21:16:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179303  13 58498 76588229 A  ERRORERROR'
2019-01-15 21:16:28 [DEBUG   ] Got command RPT from MCS: ref #1179305
2019-01-15 21:16:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:16:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179305  77 58498 76588433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:16:28 [DEBUG   ] Got command RPT from MCS: ref #1179306
2019-01-15 21:16:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 21:16:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179306  12 58498 76588625 A  ERRORB”™š'
2019-01-15 21:16:33 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 21:16:53 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 21:17:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:17:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:17:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:17:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:17:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:17:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:17:09 [DEBUG   ] Finished updating board flags in 1.421 seconds
2019-01-15 21:17:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 21:17:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 21:17:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 21:18:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:18:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 21:18:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:18:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:18:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:18:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:18:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:18:09 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-01-15 21:18:13 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 21:18:33 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 21:18:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 21:19:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:19:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:19:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:19:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:19:09 [WARNING ] (13, 1, 'bot')
2019-01-15 21:19:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:19:09 [DEBUG   ] Finished updating board flags in 1.379 seconds
2019-01-15 21:19:13 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 21:19:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 21:19:53 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 21:20:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:20:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 21:20:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:20:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:20:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:20:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:20:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:20:10 [DEBUG   ] Finished updating board flags in 2.047 seconds
2019-01-15 21:20:13 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 21:20:34 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 21:20:54 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 21:21:05 [DEBUG   ] Got command RPT from MCS: ref #1179319
2019-01-15 21:21:05 [DEBUG   ] summary = ERROR
2019-01-15 21:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179319  13 58498 76865117 A  ERRORERROR'
2019-01-15 21:21:05 [DEBUG   ] Got command RPT from MCS: ref #1179320
2019-01-15 21:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179320  77 58498 76865118 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:21:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:21:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:21:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:21:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:21:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:21:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:21:10 [DEBUG   ] Finished updating board flags in 1.972 seconds
2019-01-15 21:21:14 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2019-01-15 21:21:27 [DEBUG   ] Got command RPT from MCS: ref #1179336
2019-01-15 21:21:27 [DEBUG   ] summary = ERROR
2019-01-15 21:21:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179336  13 58498 76887905 A  ERRORERROR'
2019-01-15 21:21:28 [DEBUG   ] Got command RPT from MCS: ref #1179337
2019-01-15 21:21:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:21:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179337  77 58498 76888109 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:21:28 [DEBUG   ] Got command RPT from MCS: ref #1179338
2019-01-15 21:21:28 [DEBUG   ] summary = ERROR
2019-01-15 21:21:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179338  13 58498 76888313 A  ERRORERROR'
2019-01-15 21:21:28 [DEBUG   ] Got command RPT from MCS: ref #1179339
2019-01-15 21:21:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:21:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179339  77 58498 76888505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:21:28 [DEBUG   ] Got command RPT from MCS: ref #1179340
2019-01-15 21:21:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 21:21:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179340  12 58498 76888709 A  ERRORB—™š'
2019-01-15 21:21:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 21:21:54 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 21:22:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 21:22:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:22:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:22:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:22:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:22:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:22:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:22:10 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-01-15 21:22:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 21:22:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 21:22:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 21:23:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:23:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:23:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:23:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:23:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:23:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:23:10 [DEBUG   ] Finished updating board flags in 1.792 seconds
2019-01-15 21:23:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 21:23:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 21:23:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 21:24:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:24:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:24:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:24:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:24:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:24:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:24:10 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-01-15 21:24:15 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 21:24:35 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 21:24:55 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 21:25:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:25:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:25:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:25:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:25:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:25:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:25:10 [DEBUG   ] Finished updating board flags in 1.591 seconds
2019-01-15 21:25:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-15 21:25:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 21:25:55 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 21:26:05 [DEBUG   ] Got command RPT from MCS: ref #1179345
2019-01-15 21:26:05 [DEBUG   ] summary = ERROR
2019-01-15 21:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179345  13 58498 77165113 A  ERRORERROR'
2019-01-15 21:26:05 [DEBUG   ] Got command RPT from MCS: ref #1179346
2019-01-15 21:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179346  77 58498 77165114 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:26:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:26:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:26:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:26:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:26:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:26:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:26:10 [DEBUG   ] Finished updating board flags in 1.423 seconds
2019-01-15 21:26:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 21:26:27 [DEBUG   ] Got command RPT from MCS: ref #1179364
2019-01-15 21:26:27 [DEBUG   ] summary = ERROR
2019-01-15 21:26:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179364  13 58498 77187993 A  ERRORERROR'
2019-01-15 21:26:28 [DEBUG   ] Got command RPT from MCS: ref #1179365
2019-01-15 21:26:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:26:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179365  77 58498 77188197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:26:28 [DEBUG   ] Got command RPT from MCS: ref #1179366
2019-01-15 21:26:28 [DEBUG   ] summary = ERROR
2019-01-15 21:26:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179366  13 58498 77188389 A  ERRORERROR'
2019-01-15 21:26:28 [DEBUG   ] Got command RPT from MCS: ref #1179368
2019-01-15 21:26:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:26:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179368  77 58498 77188593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:26:28 [DEBUG   ] Got command RPT from MCS: ref #1179370
2019-01-15 21:26:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 21:26:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179370  12 58498 77188797 A  ERRORB—™š'
2019-01-15 21:26:35 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 21:26:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 21:27:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:27:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:27:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:27:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:27:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:27:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:27:10 [DEBUG   ] Finished updating board flags in 1.386 seconds
2019-01-15 21:27:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 21:27:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 21:27:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 21:28:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:28:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:28:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:28:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:28:10 [WARNING ] (13, 1, 'bot')
2019-01-15 21:28:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:28:10 [DEBUG   ] Finished updating board flags in 1.362 seconds
2019-01-15 21:28:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 21:28:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 21:28:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 21:29:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:29:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:29:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:29:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:29:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:29:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:29:11 [DEBUG   ] Finished updating board flags in 2.056 seconds
2019-01-15 21:29:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 21:29:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 21:29:55 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 21:30:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:30:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 21:30:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:30:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:30:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:30:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:30:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:30:11 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-01-15 21:30:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 21:30:35 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 21:30:56 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 21:31:05 [DEBUG   ] Got command RPT from MCS: ref #1179382
2019-01-15 21:31:05 [DEBUG   ] summary = ERROR
2019-01-15 21:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179382  13 58498 77465117 A  ERRORERROR'
2019-01-15 21:31:05 [DEBUG   ] Got command RPT from MCS: ref #1179383
2019-01-15 21:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179383  77 58498 77465118 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:31:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:31:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:31:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:31:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:31:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:31:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:31:11 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-01-15 21:31:16 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 21:31:28 [DEBUG   ] Got command RPT from MCS: ref #1179399
2019-01-15 21:31:28 [DEBUG   ] summary = ERROR
2019-01-15 21:31:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179399  13 58498 77488070 A  ERRORERROR'
2019-01-15 21:31:28 [DEBUG   ] Got command RPT from MCS: ref #1179400
2019-01-15 21:31:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:31:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179400  77 58498 77488273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:31:28 [DEBUG   ] Got command RPT from MCS: ref #1179401
2019-01-15 21:31:28 [DEBUG   ] summary = ERROR
2019-01-15 21:31:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179401  13 58498 77488477 A  ERRORERROR'
2019-01-15 21:31:28 [DEBUG   ] Got command RPT from MCS: ref #1179402
2019-01-15 21:31:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:31:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179402  77 58498 77488669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:31:28 [DEBUG   ] Got command RPT from MCS: ref #1179403
2019-01-15 21:31:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 21:31:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179403  12 58498 77488873 A  ERRORB–™š'
2019-01-15 21:31:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 21:31:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 21:32:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:32:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:32:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:32:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:32:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:32:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:32:11 [DEBUG   ] Finished updating board flags in 1.807 seconds
2019-01-15 21:32:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 21:32:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 21:32:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 21:33:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:33:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:33:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:33:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:33:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:33:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:33:11 [DEBUG   ] Finished updating board flags in 1.796 seconds
2019-01-15 21:33:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 21:33:37 [DEBUG   ] Finished updating ant stats in 1.803 seconds
2019-01-15 21:33:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 21:34:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:34:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:34:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:34:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:34:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:34:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:34:11 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-15 21:34:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 21:34:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 21:34:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 21:35:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:35:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:35:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:35:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:35:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:35:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:35:11 [DEBUG   ] Finished updating board flags in 1.596 seconds
2019-01-15 21:35:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 21:35:36 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 21:35:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 21:36:05 [DEBUG   ] Got command RPT from MCS: ref #1179412
2019-01-15 21:36:05 [DEBUG   ] summary = ERROR
2019-01-15 21:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179412  13 58498 77765121 A  ERRORERROR'
2019-01-15 21:36:05 [DEBUG   ] Got command RPT from MCS: ref #1179413
2019-01-15 21:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179413  77 58498 77765122 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:36:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:36:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 21:36:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:36:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:36:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:36:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:36:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:36:11 [DEBUG   ] Finished updating board flags in 1.513 seconds
2019-01-15 21:36:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 21:36:28 [DEBUG   ] Got command RPT from MCS: ref #1179431
2019-01-15 21:36:28 [DEBUG   ] summary = ERROR
2019-01-15 21:36:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179431  13 58498 77788153 A  ERRORERROR'
2019-01-15 21:36:28 [DEBUG   ] Got command RPT from MCS: ref #1179432
2019-01-15 21:36:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:36:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179432  77 58498 77788345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:36:28 [DEBUG   ] Got command RPT from MCS: ref #1179433
2019-01-15 21:36:28 [DEBUG   ] summary = ERROR
2019-01-15 21:36:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179433  13 58498 77788549 A  ERRORERROR'
2019-01-15 21:36:28 [DEBUG   ] Got command RPT from MCS: ref #1179435
2019-01-15 21:36:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:36:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179435  77 58498 77788753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:36:28 [DEBUG   ] Got command RPT from MCS: ref #1179436
2019-01-15 21:36:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 21:36:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179436  12 58498 77788957 A  ERRORB–™š'
2019-01-15 21:36:36 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 21:36:56 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 21:37:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2019-01-15 21:37:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:37:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 21:37:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:37:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:37:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:37:11 [WARNING ] (13, 1, 'bot')
2019-01-15 21:37:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:37:11 [DEBUG   ] Finished updating board flags in 1.515 seconds
2019-01-15 21:37:16 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-01-15 21:37:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 21:37:57 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 21:38:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:38:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:38:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:38:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:38:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:38:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:38:12 [DEBUG   ] Finished updating board flags in 2.274 seconds
2019-01-15 21:38:17 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 21:38:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 21:38:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 21:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:39:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:39:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:39:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:39:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:39:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:39:12 [DEBUG   ] Finished updating board flags in 2.106 seconds
2019-01-15 21:39:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 21:39:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 21:39:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 21:40:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:40:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:40:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:40:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:40:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:40:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:40:12 [DEBUG   ] Finished updating board flags in 2.015 seconds
2019-01-15 21:40:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 21:40:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 21:40:57 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 21:41:05 [DEBUG   ] Got command RPT from MCS: ref #1179445
2019-01-15 21:41:05 [DEBUG   ] summary = ERROR
2019-01-15 21:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179445  13 58498 78065121 A  ERRORERROR'
2019-01-15 21:41:05 [DEBUG   ] Got command RPT from MCS: ref #1179446
2019-01-15 21:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179446  77 58498 78065122 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:41:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:41:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:41:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:41:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:41:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:41:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:41:12 [DEBUG   ] Finished updating board flags in 1.986 seconds
2019-01-15 21:41:18 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 21:41:28 [DEBUG   ] Got command RPT from MCS: ref #1179462
2019-01-15 21:41:28 [DEBUG   ] summary = ERROR
2019-01-15 21:41:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179462  13 58498 78088253 A  ERRORERROR'
2019-01-15 21:41:28 [DEBUG   ] Got command RPT from MCS: ref #1179463
2019-01-15 21:41:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:41:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179463  77 58498 78088457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:41:28 [DEBUG   ] Got command RPT from MCS: ref #1179464
2019-01-15 21:41:28 [DEBUG   ] summary = ERROR
2019-01-15 21:41:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179464  13 58498 78088661 A  ERRORERROR'
2019-01-15 21:41:28 [DEBUG   ] Got command RPT from MCS: ref #1179465
2019-01-15 21:41:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:41:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179465  77 58498 78088853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:41:29 [DEBUG   ] Got command RPT from MCS: ref #1179466
2019-01-15 21:41:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 21:41:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179466  12 58498 78089057 A  ERRORB•™š'
2019-01-15 21:41:37 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 21:41:57 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 21:42:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:42:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:42:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:42:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:42:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:42:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:42:12 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-01-15 21:42:18 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-15 21:42:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 21:42:58 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 21:43:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:43:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:43:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:43:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:43:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:43:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:43:12 [DEBUG   ] Finished updating board flags in 1.784 seconds
2019-01-15 21:43:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 21:43:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 21:43:58 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 21:44:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:44:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:44:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:44:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:44:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:44:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:44:12 [DEBUG   ] Finished updating board flags in 1.627 seconds
2019-01-15 21:44:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 21:44:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 21:44:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 21:45:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:45:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:45:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:45:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:45:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:45:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:45:12 [DEBUG   ] Finished updating board flags in 1.591 seconds
2019-01-15 21:45:18 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 21:45:38 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 21:45:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 21:46:05 [DEBUG   ] Got command RPT from MCS: ref #1179475
2019-01-15 21:46:05 [DEBUG   ] summary = ERROR
2019-01-15 21:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179475  13 58498 78365121 A  ERRORERROR'
2019-01-15 21:46:05 [DEBUG   ] Got command RPT from MCS: ref #1179476
2019-01-15 21:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179476  77 58498 78365122 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:46:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:46:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:46:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:46:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:46:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:46:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:46:12 [DEBUG   ] Finished updating board flags in 1.406 seconds
2019-01-15 21:46:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 21:46:28 [DEBUG   ] Got command RPT from MCS: ref #1179494
2019-01-15 21:46:28 [DEBUG   ] summary = ERROR
2019-01-15 21:46:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179494  13 58498 78388329 A  ERRORERROR'
2019-01-15 21:46:28 [DEBUG   ] Got command RPT from MCS: ref #1179495
2019-01-15 21:46:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:46:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179495  77 58498 78388533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:46:28 [DEBUG   ] Got command RPT from MCS: ref #1179496
2019-01-15 21:46:28 [DEBUG   ] summary = ERROR
2019-01-15 21:46:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179496  13 58498 78388737 A  ERRORERROR'
2019-01-15 21:46:28 [DEBUG   ] Got command RPT from MCS: ref #1179498
2019-01-15 21:46:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:46:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179498  77 58498 78388941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:46:29 [DEBUG   ] Got command RPT from MCS: ref #1179499
2019-01-15 21:46:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 21:46:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179499  12 58498 78389133 A  ERRORB”™š'
2019-01-15 21:46:38 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 21:46:58 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 21:47:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:47:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:47:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:47:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:47:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:47:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:47:12 [DEBUG   ] Finished updating board flags in 1.390 seconds
2019-01-15 21:47:19 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-15 21:47:39 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 21:47:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 21:48:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:48:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:48:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:48:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:48:12 [WARNING ] (13, 1, 'bot')
2019-01-15 21:48:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:48:12 [DEBUG   ] Finished updating board flags in 1.372 seconds
2019-01-15 21:48:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 21:48:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 21:48:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 21:49:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:49:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:49:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:49:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:49:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:49:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:49:13 [DEBUG   ] Finished updating board flags in 2.045 seconds
2019-01-15 21:49:19 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 21:49:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 21:49:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 21:50:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:50:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:50:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:50:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:50:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:50:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:50:13 [DEBUG   ] Finished updating board flags in 2.026 seconds
2019-01-15 21:50:19 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 21:50:39 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 21:50:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 21:51:05 [DEBUG   ] Got command RPT from MCS: ref #1179512
2019-01-15 21:51:05 [DEBUG   ] summary = ERROR
2019-01-15 21:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179512  13 58498 78665125 A  ERRORERROR'
2019-01-15 21:51:05 [DEBUG   ] Got command RPT from MCS: ref #1179513
2019-01-15 21:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179513  77 58498 78665126 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:51:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:51:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:51:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:51:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:51:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:51:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:51:13 [DEBUG   ] Finished updating board flags in 1.966 seconds
2019-01-15 21:51:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 21:51:28 [DEBUG   ] Got command RPT from MCS: ref #1179529
2019-01-15 21:51:28 [DEBUG   ] summary = ERROR
2019-01-15 21:51:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179529  13 58498 78688413 A  ERRORERROR'
2019-01-15 21:51:28 [DEBUG   ] Got command RPT from MCS: ref #1179530
2019-01-15 21:51:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:51:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179530  77 58498 78688617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:51:28 [DEBUG   ] Got command RPT from MCS: ref #1179531
2019-01-15 21:51:28 [DEBUG   ] summary = ERROR
2019-01-15 21:51:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179531  13 58498 78688821 A  ERRORERROR'
2019-01-15 21:51:29 [DEBUG   ] Got command RPT from MCS: ref #1179532
2019-01-15 21:51:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:51:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179532  77 58498 78689013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:51:29 [DEBUG   ] Got command RPT from MCS: ref #1179533
2019-01-15 21:51:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 21:51:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179533  12 58498 78689217 A  ERRORB”™š'
2019-01-15 21:51:40 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 21:52:00 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 21:52:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 21:52:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:52:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:52:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:52:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:52:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:52:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:52:13 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-15 21:52:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 21:52:40 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 21:53:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 21:53:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:53:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:53:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:53:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:53:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:53:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:53:13 [DEBUG   ] Finished updating board flags in 1.802 seconds
2019-01-15 21:53:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 21:53:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 21:54:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 21:54:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:54:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:54:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:54:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:54:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:54:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:54:13 [DEBUG   ] Finished updating board flags in 1.791 seconds
2019-01-15 21:54:20 [DEBUG   ] Finished updating ant stats in 0.987 seconds
2019-01-15 21:54:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 21:55:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 21:55:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:55:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:55:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:55:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:55:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:55:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:55:13 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-01-15 21:55:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 21:55:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 21:56:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 21:56:05 [DEBUG   ] Got command RPT from MCS: ref #1179538
2019-01-15 21:56:05 [DEBUG   ] summary = ERROR
2019-01-15 21:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179538  13 58498 78965121 A  ERRORERROR'
2019-01-15 21:56:05 [DEBUG   ] Got command RPT from MCS: ref #1179539
2019-01-15 21:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179539  77 58498 78965122 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:56:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:56:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:56:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:56:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:56:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:56:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:56:13 [DEBUG   ] Finished updating board flags in 1.600 seconds
2019-01-15 21:56:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 21:56:28 [DEBUG   ] Got command RPT from MCS: ref #1179557
2019-01-15 21:56:28 [DEBUG   ] summary = ERROR
2019-01-15 21:56:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179557  13 58498 78988493 A  ERRORERROR'
2019-01-15 21:56:28 [DEBUG   ] Got command RPT from MCS: ref #1179558
2019-01-15 21:56:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:56:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179558  77 58498 78988697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:56:28 [DEBUG   ] Got command RPT from MCS: ref #1179559
2019-01-15 21:56:28 [DEBUG   ] summary = ERROR
2019-01-15 21:56:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179559  13 58498 78988901 A  ERRORERROR'
2019-01-15 21:56:29 [DEBUG   ] Got command RPT from MCS: ref #1179561
2019-01-15 21:56:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 21:56:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179561  77 58498 78989093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 21:56:29 [DEBUG   ] Got command RPT from MCS: ref #1179562
2019-01-15 21:56:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 21:56:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179562  12 58498 78989297 A  ERRORB—™š'
2019-01-15 21:56:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 21:57:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 21:57:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:57:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:57:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:57:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:57:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:57:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:57:13 [DEBUG   ] Finished updating board flags in 1.390 seconds
2019-01-15 21:57:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 21:57:41 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 21:58:00 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 21:58:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:58:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:58:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:58:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:58:13 [WARNING ] (13, 1, 'bot')
2019-01-15 21:58:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:58:13 [DEBUG   ] Finished updating board flags in 1.376 seconds
2019-01-15 21:58:20 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-15 21:58:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 21:59:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 21:59:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 21:59:14 [WARNING ] (13, 1, 'bot')
2019-01-15 21:59:14 [WARNING ] (13, 1, 'bot')
2019-01-15 21:59:14 [WARNING ] (13, 1, 'bot')
2019-01-15 21:59:14 [WARNING ] (13, 1, 'bot')
2019-01-15 21:59:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 21:59:14 [DEBUG   ] Finished updating board flags in 2.041 seconds
2019-01-15 21:59:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 21:59:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 22:00:01 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2019-01-15 22:00:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:00:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:00:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:00:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:00:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:00:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:00:14 [DEBUG   ] Finished updating board flags in 1.984 seconds
2019-01-15 22:00:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 22:00:41 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 22:01:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 22:01:05 [DEBUG   ] Got command RPT from MCS: ref #1179575
2019-01-15 22:01:05 [DEBUG   ] summary = ERROR
2019-01-15 22:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179575  13 58498 79265121 A  ERRORERROR'
2019-01-15 22:01:05 [DEBUG   ] Got command RPT from MCS: ref #1179576
2019-01-15 22:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179576  77 58498 79265122 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:01:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:01:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:01:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:01:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:01:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:01:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:01:14 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-01-15 22:01:21 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 22:01:28 [DEBUG   ] Got command RPT from MCS: ref #1179592
2019-01-15 22:01:28 [DEBUG   ] summary = ERROR
2019-01-15 22:01:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179592  13 58498 79288577 A  ERRORERROR'
2019-01-15 22:01:28 [DEBUG   ] Got command RPT from MCS: ref #1179593
2019-01-15 22:01:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:01:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179593  77 58498 79288781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:01:28 [DEBUG   ] Got command RPT from MCS: ref #1179594
2019-01-15 22:01:28 [DEBUG   ] summary = ERROR
2019-01-15 22:01:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179594  13 58498 79288999 A  ERRORERROR'
2019-01-15 22:01:29 [DEBUG   ] Got command RPT from MCS: ref #1179595
2019-01-15 22:01:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:01:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179595  77 58498 79289177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:01:29 [DEBUG   ] Got command RPT from MCS: ref #1179596
2019-01-15 22:01:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 22:01:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179596  12 58498 79289381 A  ERRORB—™š'
2019-01-15 22:01:41 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 22:02:01 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 22:02:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:02:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:02:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:02:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:02:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:02:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:02:14 [DEBUG   ] Finished updating board flags in 1.837 seconds
2019-01-15 22:02:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 22:02:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 22:03:01 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-01-15 22:03:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:03:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:03:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:03:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:03:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:03:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:03:14 [DEBUG   ] Finished updating board flags in 1.753 seconds
2019-01-15 22:03:22 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-01-15 22:03:42 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 22:04:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 22:04:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:04:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 22:04:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:04:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:04:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:04:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:04:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:04:14 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-01-15 22:04:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 22:04:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 22:05:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 22:05:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:05:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:05:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:05:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:05:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:05:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:05:14 [DEBUG   ] Finished updating board flags in 1.588 seconds
2019-01-15 22:05:22 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2019-01-15 22:05:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 22:06:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 22:06:05 [DEBUG   ] Got command RPT from MCS: ref #1179605
2019-01-15 22:06:05 [DEBUG   ] summary = ERROR
2019-01-15 22:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179605  13 58498 79565121 A  ERRORERROR'
2019-01-15 22:06:05 [DEBUG   ] Got command RPT from MCS: ref #1179606
2019-01-15 22:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179606  77 58498 79565122 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:06:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:06:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:06:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:06:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:06:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:06:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:06:14 [DEBUG   ] Finished updating board flags in 1.408 seconds
2019-01-15 22:06:22 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-15 22:06:28 [DEBUG   ] Got command RPT from MCS: ref #1179624
2019-01-15 22:06:28 [DEBUG   ] summary = ERROR
2019-01-15 22:06:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179624  13 58498 79588653 A  ERRORERROR'
2019-01-15 22:06:28 [DEBUG   ] Got command RPT from MCS: ref #1179625
2019-01-15 22:06:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:06:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179625  77 58498 79588857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:06:29 [DEBUG   ] Got command RPT from MCS: ref #1179626
2019-01-15 22:06:29 [DEBUG   ] summary = ERROR
2019-01-15 22:06:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179626  13 58498 79589061 A  ERRORERROR'
2019-01-15 22:06:29 [DEBUG   ] Got command RPT from MCS: ref #1179628
2019-01-15 22:06:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:06:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179628  77 58498 79589265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:06:29 [DEBUG   ] Got command RPT from MCS: ref #1179629
2019-01-15 22:06:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 22:06:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179629  12 58498 79589457 A  ERRORB–™š'
2019-01-15 22:06:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 22:07:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 22:07:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:07:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:07:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:07:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:07:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:07:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:07:14 [DEBUG   ] Finished updating board flags in 1.390 seconds
2019-01-15 22:07:22 [DEBUG   ] Finished updating ant stats in 0.587 seconds
2019-01-15 22:07:43 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 22:08:03 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 22:08:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:08:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:08:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:08:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:08:14 [WARNING ] (13, 1, 'bot')
2019-01-15 22:08:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:08:14 [DEBUG   ] Finished updating board flags in 1.362 seconds
2019-01-15 22:08:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 22:08:43 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 22:09:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 22:09:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:09:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:09:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:09:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:09:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:09:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:09:15 [DEBUG   ] Finished updating board flags in 2.056 seconds
2019-01-15 22:09:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 22:09:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 22:10:03 [DEBUG   ] Finished updating ant stats in 0.988 seconds
2019-01-15 22:10:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:10:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:10:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:10:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:10:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:10:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:10:15 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-01-15 22:10:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 22:10:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 22:11:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 22:11:05 [DEBUG   ] Got command RPT from MCS: ref #1179638
2019-01-15 22:11:05 [DEBUG   ] summary = ERROR
2019-01-15 22:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179638  13 58498 79865129 A  ERRORERROR'
2019-01-15 22:11:05 [DEBUG   ] Got command RPT from MCS: ref #1179639
2019-01-15 22:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179639  77 58498 79865130 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:11:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:11:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:11:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:11:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:11:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:11:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:11:15 [DEBUG   ] Finished updating board flags in 1.823 seconds
2019-01-15 22:11:23 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 22:11:28 [DEBUG   ] Got command RPT from MCS: ref #1179655
2019-01-15 22:11:28 [DEBUG   ] summary = ERROR
2019-01-15 22:11:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179655  13 58498 79888733 A  ERRORERROR'
2019-01-15 22:11:28 [DEBUG   ] Got command RPT from MCS: ref #1179656
2019-01-15 22:11:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:11:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179656  77 58498 79888937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:11:29 [DEBUG   ] Got command RPT from MCS: ref #1179657
2019-01-15 22:11:29 [DEBUG   ] summary = ERROR
2019-01-15 22:11:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179657  13 58498 79889141 A  ERRORERROR'
2019-01-15 22:11:29 [DEBUG   ] Got command RPT from MCS: ref #1179658
2019-01-15 22:11:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:11:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179658  77 58498 79889345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:11:29 [DEBUG   ] Got command RPT from MCS: ref #1179659
2019-01-15 22:11:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 22:11:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179659  12 58498 79889537 A  ERRORB•™š'
2019-01-15 22:11:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 22:12:03 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 22:12:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:12:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:12:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:12:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:12:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:12:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:12:15 [DEBUG   ] Finished updating board flags in 1.820 seconds
2019-01-15 22:12:23 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 22:12:44 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 22:13:04 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 22:13:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:13:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:13:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:13:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:13:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:13:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:13:15 [DEBUG   ] Finished updating board flags in 1.771 seconds
2019-01-15 22:13:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 22:13:44 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 22:14:04 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 22:14:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:14:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:14:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:14:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:14:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:14:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:14:15 [DEBUG   ] Finished updating board flags in 1.603 seconds
2019-01-15 22:14:24 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 22:14:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 22:15:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 22:15:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:15:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:15:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:15:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:15:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:15:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:15:15 [DEBUG   ] Finished updating board flags in 1.603 seconds
2019-01-15 22:15:24 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-01-15 22:15:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 22:16:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 22:16:05 [DEBUG   ] Got command RPT from MCS: ref #1179668
2019-01-15 22:16:05 [DEBUG   ] summary = ERROR
2019-01-15 22:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179668  13 58498 80165121 A  ERRORERROR'
2019-01-15 22:16:05 [DEBUG   ] Got command RPT from MCS: ref #1179669
2019-01-15 22:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179669  77 58498 80165122 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:16:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:16:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:16:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:16:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:16:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:16:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:16:15 [DEBUG   ] Finished updating board flags in 1.600 seconds
2019-01-15 22:16:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 22:16:28 [DEBUG   ] Got command RPT from MCS: ref #1179687
2019-01-15 22:16:28 [DEBUG   ] summary = ERROR
2019-01-15 22:16:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179687  13 58498 80188821 A  ERRORERROR'
2019-01-15 22:16:29 [DEBUG   ] Got command RPT from MCS: ref #1179688
2019-01-15 22:16:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:16:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179688  77 58498 80189026 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:16:29 [DEBUG   ] Got command RPT from MCS: ref #1179689
2019-01-15 22:16:29 [DEBUG   ] summary = ERROR
2019-01-15 22:16:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179689  13 58498 80189217 A  ERRORERROR'
2019-01-15 22:16:29 [DEBUG   ] Got command RPT from MCS: ref #1179691
2019-01-15 22:16:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:16:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179691  77 58498 80189421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:16:29 [DEBUG   ] Got command RPT from MCS: ref #1179692
2019-01-15 22:16:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 22:16:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179692  12 58498 80189625 A  ERRORB•™š'
2019-01-15 22:16:44 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 22:17:05 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 22:17:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:17:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:17:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:17:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:17:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:17:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:17:15 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-01-15 22:17:25 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 22:17:45 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 22:18:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 22:18:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:18:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:18:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:18:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:18:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:18:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:18:15 [DEBUG   ] Finished updating board flags in 1.603 seconds
2019-01-15 22:18:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 22:18:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 22:19:05 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 22:19:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:19:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:19:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:19:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:19:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:19:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:19:15 [DEBUG   ] Finished updating board flags in 1.591 seconds
2019-01-15 22:19:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 22:19:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 22:20:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 22:20:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:20:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:20:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:20:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:20:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:20:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:20:15 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-01-15 22:20:25 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 22:20:46 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 22:21:05 [DEBUG   ] Got command RPT from MCS: ref #1179705
2019-01-15 22:21:05 [DEBUG   ] summary = ERROR
2019-01-15 22:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179705  13 58498 80465130 A  ERRORERROR'
2019-01-15 22:21:05 [DEBUG   ] Got command RPT from MCS: ref #1179706
2019-01-15 22:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179706  77 58498 80465130 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:21:06 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 22:21:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:21:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:21:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:21:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:21:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:21:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:21:15 [DEBUG   ] Finished updating board flags in 1.399 seconds
2019-01-15 22:21:26 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 22:21:28 [DEBUG   ] Got command RPT from MCS: ref #1179722
2019-01-15 22:21:28 [DEBUG   ] summary = ERROR
2019-01-15 22:21:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179722  13 58498 80488901 A  ERRORERROR'
2019-01-15 22:21:29 [DEBUG   ] Got command RPT from MCS: ref #1179723
2019-01-15 22:21:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:21:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179723  77 58498 80489093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:21:29 [DEBUG   ] Got command RPT from MCS: ref #1179724
2019-01-15 22:21:29 [DEBUG   ] summary = ERROR
2019-01-15 22:21:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179724  13 58498 80489297 A  ERRORERROR'
2019-01-15 22:21:29 [DEBUG   ] Got command RPT from MCS: ref #1179725
2019-01-15 22:21:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:21:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179725  77 58498 80489501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:21:29 [DEBUG   ] Got command RPT from MCS: ref #1179726
2019-01-15 22:21:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 22:21:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179726  12 58498 80489705 A  ERRORB–™š'
2019-01-15 22:21:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 22:22:06 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 22:22:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:22:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:22:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:22:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:22:15 [WARNING ] (13, 1, 'bot')
2019-01-15 22:22:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:22:15 [DEBUG   ] Finished updating board flags in 1.361 seconds
2019-01-15 22:22:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 22:22:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 22:23:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 22:23:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:23:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:23:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:23:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:23:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:23:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:23:16 [DEBUG   ] Finished updating board flags in 2.042 seconds
2019-01-15 22:23:26 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-15 22:23:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 22:24:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 22:24:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:24:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:24:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:24:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:24:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:24:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:24:16 [DEBUG   ] Finished updating board flags in 2.011 seconds
2019-01-15 22:24:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 22:24:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 22:25:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 22:25:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:25:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 22:25:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:25:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:25:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:25:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:25:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:25:16 [DEBUG   ] Finished updating board flags in 2.025 seconds
2019-01-15 22:25:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 22:25:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 22:26:05 [DEBUG   ] Got command RPT from MCS: ref #1179731
2019-01-15 22:26:05 [DEBUG   ] summary = ERROR
2019-01-15 22:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179731  13 58498 80765125 A  ERRORERROR'
2019-01-15 22:26:05 [DEBUG   ] Got command RPT from MCS: ref #1179732
2019-01-15 22:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179732  77 58498 80765126 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:26:06 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 22:26:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:26:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:26:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:26:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:26:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:26:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:26:16 [DEBUG   ] Finished updating board flags in 2.013 seconds
2019-01-15 22:26:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 22:26:28 [DEBUG   ] Got command RPT from MCS: ref #1179750
2019-01-15 22:26:28 [DEBUG   ] summary = ERROR
2019-01-15 22:26:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179750  13 58498 80788977 A  ERRORERROR'
2019-01-15 22:26:29 [DEBUG   ] Got command RPT from MCS: ref #1179751
2019-01-15 22:26:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:26:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179751  77 58498 80789181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:26:29 [DEBUG   ] Got command RPT from MCS: ref #1179752
2019-01-15 22:26:29 [DEBUG   ] summary = ERROR
2019-01-15 22:26:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179752  13 58498 80789373 A  ERRORERROR'
2019-01-15 22:26:29 [DEBUG   ] Got command RPT from MCS: ref #1179754
2019-01-15 22:26:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:26:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179754  77 58498 80789577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:26:29 [DEBUG   ] Got command RPT from MCS: ref #1179755
2019-01-15 22:26:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 22:26:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179755  12 58498 80789781 A  ERRORB˜™š'
2019-01-15 22:26:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 22:27:07 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 22:27:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:27:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:27:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:27:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:27:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:27:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:27:16 [DEBUG   ] Finished updating board flags in 1.947 seconds
2019-01-15 22:27:27 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 22:27:47 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 22:28:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 22:28:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:28:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:28:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:28:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:28:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:28:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:28:16 [DEBUG   ] Finished updating board flags in 1.823 seconds
2019-01-15 22:28:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 22:28:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 22:29:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 22:29:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-15 22:29:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:29:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:29:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:29:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:29:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:29:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:29:16 [DEBUG   ] Finished updating board flags in 1.789 seconds
2019-01-15 22:29:27 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 22:29:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 22:30:00 [DEBUG   ] Got command TBN from MCS: ref #1179768
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547591401']
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547591401']
2019-01-15 22:30:00 [DEBUG   ] tbn = exited with status True, code 0x00
2019-01-15 22:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN  1179768   8 58498 81000494 A  ERROR'
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547591401']
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547591401']
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547591401']
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547591401']
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547591401']
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547591401']
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547591401']
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547591401']
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547591401']
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547591401']
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547591401']
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547591401']
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547591401']
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547591401']
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547591401']
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547591401']
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547591401']
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547591401']
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547591401']
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547591401']
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547591401']
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547591401']
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547591401']
2019-01-15 22:30:00 [DEBUG   ] spawn_process: at 2019-01-15 22:30:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547591401']
2019-01-15 22:30:00 [INFO    ] Finished spawning TBN in 0.052 s
2019-01-15 22:30:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 22:30:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:30:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:30:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:30:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:30:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:30:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:30:16 [DEBUG   ] Finished updating board flags in 1.609 seconds
2019-01-15 22:30:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 22:30:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 22:31:05 [DEBUG   ] Got command RPT from MCS: ref #1179769
2019-01-15 22:31:05 [DEBUG   ] summary = ERROR
2019-01-15 22:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179769  13 58498 81065129 A  ERRORERROR'
2019-01-15 22:31:05 [DEBUG   ] Got command RPT from MCS: ref #1179770
2019-01-15 22:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179770  77 58498 81065130 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:31:08 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 22:31:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:31:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:31:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:31:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:31:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:31:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:31:16 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-15 22:31:28 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 22:31:29 [DEBUG   ] Got command RPT from MCS: ref #1179786
2019-01-15 22:31:29 [DEBUG   ] summary = ERROR
2019-01-15 22:31:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179786  13 58498 81089053 A  ERRORERROR'
2019-01-15 22:31:29 [DEBUG   ] Got command RPT from MCS: ref #1179787
2019-01-15 22:31:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:31:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179787  77 58498 81089257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:31:29 [DEBUG   ] Got command RPT from MCS: ref #1179788
2019-01-15 22:31:29 [DEBUG   ] summary = ERROR
2019-01-15 22:31:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179788  13 58498 81089461 A  ERRORERROR'
2019-01-15 22:31:29 [DEBUG   ] Got command RPT from MCS: ref #1179789
2019-01-15 22:31:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:31:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179789  77 58498 81089665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:31:29 [DEBUG   ] Got command RPT from MCS: ref #1179790
2019-01-15 22:31:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 22:31:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179790  12 58498 81089857 A  ERRORB—™š'
2019-01-15 22:31:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 22:32:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 22:32:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:32:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:32:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:32:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:32:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:32:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:32:16 [DEBUG   ] Finished updating board flags in 1.585 seconds
2019-01-15 22:32:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 22:32:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 22:33:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 22:33:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:33:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:33:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:33:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:33:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:33:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:33:16 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-15 22:33:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 22:33:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 22:34:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 22:34:11 [DEBUG   ] Got command TBW from MCS: ref #1179796
2019-01-15 22:34:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-01-15 22:34:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1179796   8 58498 81251569 A  ERROR'
2019-01-15 22:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-01-15 22:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-01-15 22:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-01-15 22:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-01-15 22:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-01-15 22:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-01-15 22:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-01-15 22:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-01-15 22:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-01-15 22:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-01-15 22:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-01-15 22:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-01-15 22:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-01-15 22:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-01-15 22:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-01-15 22:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-01-15 22:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-01-15 22:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-01-15 22:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-01-15 22:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-01-15 22:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-01-15 22:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-01-15 22:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-01-15 22:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-01-15 22:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-01-15 22:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-01-15 22:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-01-15 22:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-01-15 22:34:15 [DEBUG   ] spawn_process: at 2019-01-15 22:34:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-01-15 22:34:15 [INFO    ] Finished spawning TBW
2019-01-15 22:34:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:34:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:34:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:34:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:34:16 [WARNING ] (13, 1, 'bot')
2019-01-15 22:34:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:34:16 [DEBUG   ] Finished updating board flags in 1.198 seconds
2019-01-15 22:35:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:35:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:35:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:35:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:35:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:35:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:35:17 [DEBUG   ] Finished updating board flags in 2.164 seconds
2019-01-15 22:36:03 [INFO    ] __waitForTBW - TBW finished in 108.709 s
2019-01-15 22:36:04 [DEBUG   ] Finished updating ant stats in 0.496 seconds
2019-01-15 22:36:04 [INFO    ] Started antennas statistics background thread
2019-01-15 22:36:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547591766']
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547591766']
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547591766']
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547591766']
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547591766']
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547591766']
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547591766']
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547591766']
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547591766']
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547591766']
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547591766']
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547591766']
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547591766']
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547591766']
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547591766']
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547591766']
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547591766']
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547591766']
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547591766']
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547591766']
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547591766']
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547591766']
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547591766']
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547591766']
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547591766']
2019-01-15 22:36:04 [DEBUG   ] spawn_process: at 2019-01-15 22:36:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547591766']
2019-01-15 22:36:04 [INFO    ] Finished spawning TBN in 0.049 s
2019-01-15 22:36:05 [DEBUG   ] Got command RPT from MCS: ref #1179805
2019-01-15 22:36:05 [DEBUG   ] summary = ERROR
2019-01-15 22:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179805  13 58498 81365133 A  ERRORERROR'
2019-01-15 22:36:05 [DEBUG   ] Got command RPT from MCS: ref #1179806
2019-01-15 22:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179806  77 58498 81365134 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:36:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:36:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:36:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:36:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:36:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:36:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:36:17 [DEBUG   ] Finished updating board flags in 2.173 seconds
2019-01-15 22:36:24 [DEBUG   ] Finished updating ant stats in 0.466 seconds
2019-01-15 22:36:29 [DEBUG   ] Got command RPT from MCS: ref #1179825
2019-01-15 22:36:29 [DEBUG   ] summary = ERROR
2019-01-15 22:36:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179825  13 58498 81389137 A  ERRORERROR'
2019-01-15 22:36:29 [DEBUG   ] Got command RPT from MCS: ref #1179826
2019-01-15 22:36:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:36:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179826  77 58498 81389341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:36:29 [DEBUG   ] Got command RPT from MCS: ref #1179827
2019-01-15 22:36:29 [DEBUG   ] summary = ERROR
2019-01-15 22:36:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179827  13 58498 81389533 A  ERRORERROR'
2019-01-15 22:36:29 [DEBUG   ] Got command RPT from MCS: ref #1179828
2019-01-15 22:36:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:36:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179828  77 58498 81389737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:36:29 [DEBUG   ] Got command RPT from MCS: ref #1179831
2019-01-15 22:36:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 22:36:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179831  12 58498 81389941 A  ERRORB–™š'
2019-01-15 22:36:44 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 22:37:05 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 22:37:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:37:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 22:37:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:37:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:37:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:37:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:37:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:37:17 [DEBUG   ] Finished updating board flags in 2.013 seconds
2019-01-15 22:37:25 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-15 22:37:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 22:38:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 22:38:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:38:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:38:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:38:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:38:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:38:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:38:17 [DEBUG   ] Finished updating board flags in 1.845 seconds
2019-01-15 22:38:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 22:38:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 22:39:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 22:39:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:39:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:39:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:39:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:39:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:39:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:39:17 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-01-15 22:39:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 22:39:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 22:40:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 22:40:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:40:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 22:40:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:40:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:40:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:40:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:40:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:40:17 [DEBUG   ] Finished updating board flags in 1.796 seconds
2019-01-15 22:40:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 22:40:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 22:41:05 [DEBUG   ] Got command RPT from MCS: ref #1179841
2019-01-15 22:41:05 [DEBUG   ] summary = ERROR
2019-01-15 22:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179841  13 58498 81665125 A  ERRORERROR'
2019-01-15 22:41:05 [DEBUG   ] Got command RPT from MCS: ref #1179842
2019-01-15 22:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179842  77 58498 81665126 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:41:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 22:41:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:41:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:41:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:41:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:41:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:41:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:41:17 [DEBUG   ] Finished updating board flags in 1.609 seconds
2019-01-15 22:41:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 22:41:29 [DEBUG   ] Got command RPT from MCS: ref #1179858
2019-01-15 22:41:29 [DEBUG   ] summary = ERROR
2019-01-15 22:41:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179858  13 58498 81689217 A  ERRORERROR'
2019-01-15 22:41:29 [DEBUG   ] Got command RPT from MCS: ref #1179859
2019-01-15 22:41:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:41:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179859  77 58498 81689421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:41:29 [DEBUG   ] Got command RPT from MCS: ref #1179860
2019-01-15 22:41:29 [DEBUG   ] summary = ERROR
2019-01-15 22:41:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179860  13 58498 81689625 A  ERRORERROR'
2019-01-15 22:41:29 [DEBUG   ] Got command RPT from MCS: ref #1179861
2019-01-15 22:41:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:41:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179861  77 58498 81689817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:41:30 [DEBUG   ] Got command RPT from MCS: ref #1179862
2019-01-15 22:41:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 22:41:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179862  12 58498 81690032 A  ERRORB•™š'
2019-01-15 22:41:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 22:42:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 22:42:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:42:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:42:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:42:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:42:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:42:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:42:17 [DEBUG   ] Finished updating board flags in 1.583 seconds
2019-01-15 22:42:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 22:42:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 22:43:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 22:43:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:43:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:43:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:43:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:43:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:43:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:43:17 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-01-15 22:43:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 22:43:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 22:44:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 22:44:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:44:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:44:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:44:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:44:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:44:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:44:17 [DEBUG   ] Finished updating board flags in 1.402 seconds
2019-01-15 22:44:25 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 22:44:46 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-15 22:45:06 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 22:45:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:45:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:45:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:45:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:45:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:45:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:45:17 [DEBUG   ] Finished updating board flags in 1.395 seconds
2019-01-15 22:45:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 22:45:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 22:46:05 [DEBUG   ] Got command RPT from MCS: ref #1179871
2019-01-15 22:46:05 [DEBUG   ] summary = ERROR
2019-01-15 22:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179871  13 58498 81965126 A  ERRORERROR'
2019-01-15 22:46:05 [DEBUG   ] Got command RPT from MCS: ref #1179872
2019-01-15 22:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179872  77 58498 81965126 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:46:06 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 22:46:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:46:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:46:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:46:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:46:17 [WARNING ] (13, 1, 'bot')
2019-01-15 22:46:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:46:17 [DEBUG   ] Finished updating board flags in 1.364 seconds
2019-01-15 22:46:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 22:46:29 [DEBUG   ] Got command RPT from MCS: ref #1179890
2019-01-15 22:46:29 [DEBUG   ] summary = ERROR
2019-01-15 22:46:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179890  13 58498 81989305 A  ERRORERROR'
2019-01-15 22:46:29 [DEBUG   ] Got command RPT from MCS: ref #1179891
2019-01-15 22:46:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:46:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179891  77 58498 81989497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:46:29 [DEBUG   ] Got command RPT from MCS: ref #1179892
2019-01-15 22:46:29 [DEBUG   ] summary = ERROR
2019-01-15 22:46:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179892  13 58498 81989701 A  ERRORERROR'
2019-01-15 22:46:29 [DEBUG   ] Got command RPT from MCS: ref #1179894
2019-01-15 22:46:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:46:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179894  77 58498 81989905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:46:30 [DEBUG   ] Got command RPT from MCS: ref #1179895
2019-01-15 22:46:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 22:46:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179895  12 58498 81990109 A  ERRORB•™š'
2019-01-15 22:46:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 22:47:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 22:47:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:47:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:47:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:47:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:47:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:47:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:47:18 [DEBUG   ] Finished updating board flags in 2.048 seconds
2019-01-15 22:47:26 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-01-15 22:47:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 22:48:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 22:48:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:48:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:48:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:48:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:48:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:48:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:48:18 [DEBUG   ] Finished updating board flags in 2.009 seconds
2019-01-15 22:48:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 22:48:47 [DEBUG   ] Finished updating ant stats in 1.799 seconds
2019-01-15 22:49:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 22:49:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:49:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:49:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:49:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:49:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:49:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:49:18 [DEBUG   ] Finished updating board flags in 1.985 seconds
2019-01-15 22:49:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 22:49:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 22:50:06 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 22:50:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:50:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:50:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:50:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:50:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:50:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:50:18 [DEBUG   ] Finished updating board flags in 1.837 seconds
2019-01-15 22:50:26 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 22:50:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 22:51:05 [DEBUG   ] Got command RPT from MCS: ref #1179916
2019-01-15 22:51:05 [DEBUG   ] summary = ERROR
2019-01-15 22:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179916  13 58498 82265137 A  ERRORERROR'
2019-01-15 22:51:05 [DEBUG   ] Got command RPT from MCS: ref #1179917
2019-01-15 22:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179917  77 58498 82265138 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:51:07 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 22:51:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:51:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:51:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:51:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:51:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:51:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:51:18 [DEBUG   ] Finished updating board flags in 1.763 seconds
2019-01-15 22:51:27 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 22:51:29 [DEBUG   ] Got command RPT from MCS: ref #1179936
2019-01-15 22:51:29 [DEBUG   ] summary = ERROR
2019-01-15 22:51:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179936  13 58498 82289385 A  ERRORERROR'
2019-01-15 22:51:29 [DEBUG   ] Got command RPT from MCS: ref #1179937
2019-01-15 22:51:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:51:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179937  77 58498 82289589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:51:29 [DEBUG   ] Got command RPT from MCS: ref #1179938
2019-01-15 22:51:29 [DEBUG   ] summary = ERROR
2019-01-15 22:51:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179938  13 58498 82289793 A  ERRORERROR'
2019-01-15 22:51:29 [DEBUG   ] Got command RPT from MCS: ref #1179939
2019-01-15 22:51:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:51:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179939  77 58498 82289985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:51:30 [DEBUG   ] Got command RPT from MCS: ref #1179940
2019-01-15 22:51:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 22:51:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179940  12 58498 82290189 A  ERRORB—™š'
2019-01-15 22:51:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 22:52:07 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 22:52:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:52:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:52:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:52:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:52:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:52:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:52:18 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-15 22:52:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 22:52:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 22:53:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 22:53:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:53:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:53:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:53:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:53:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:53:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:53:18 [DEBUG   ] Finished updating board flags in 1.587 seconds
2019-01-15 22:53:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 22:53:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 22:54:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 22:54:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:54:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 22:54:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:54:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:54:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:54:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:54:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:54:18 [DEBUG   ] Finished updating board flags in 1.424 seconds
2019-01-15 22:54:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 22:54:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 22:55:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 22:55:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:55:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:55:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:55:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:55:18 [WARNING ] (13, 1, 'bot')
2019-01-15 22:55:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:55:18 [DEBUG   ] Finished updating board flags in 1.378 seconds
2019-01-15 22:55:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 22:55:47 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-15 22:56:05 [DEBUG   ] Got command RPT from MCS: ref #1179945
2019-01-15 22:56:05 [DEBUG   ] summary = ERROR
2019-01-15 22:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179945  13 58498 82565133 A  ERRORERROR'
2019-01-15 22:56:05 [DEBUG   ] Got command RPT from MCS: ref #1179946
2019-01-15 22:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179946  77 58498 82565134 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:56:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 22:56:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:56:19 [WARNING ] (13, 1, 'bot')
2019-01-15 22:56:19 [WARNING ] (13, 1, 'bot')
2019-01-15 22:56:19 [WARNING ] (13, 1, 'bot')
2019-01-15 22:56:19 [WARNING ] (13, 1, 'bot')
2019-01-15 22:56:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:56:19 [DEBUG   ] Finished updating board flags in 1.567 seconds
2019-01-15 22:56:28 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-15 22:56:29 [DEBUG   ] Got command RPT from MCS: ref #1179964
2019-01-15 22:56:29 [DEBUG   ] summary = ERROR
2019-01-15 22:56:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179964  13 58498 82589467 A  ERRORERROR'
2019-01-15 22:56:29 [DEBUG   ] Got command RPT from MCS: ref #1179965
2019-01-15 22:56:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:56:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179965  77 58498 82589669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:56:29 [DEBUG   ] Got command RPT from MCS: ref #1179966
2019-01-15 22:56:29 [DEBUG   ] summary = ERROR
2019-01-15 22:56:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179966  13 58498 82589873 A  ERRORERROR'
2019-01-15 22:56:30 [DEBUG   ] Got command RPT from MCS: ref #1179968
2019-01-15 22:56:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 22:56:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179968  77 58498 82590065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 22:56:30 [DEBUG   ] Got command RPT from MCS: ref #1179969
2019-01-15 22:56:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 22:56:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179969  12 58498 82590269 A  ERRORB˜™š'
2019-01-15 22:56:48 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 22:57:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 22:57:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:57:19 [WARNING ] (13, 1, 'bot')
2019-01-15 22:57:19 [WARNING ] (13, 1, 'bot')
2019-01-15 22:57:19 [WARNING ] (13, 1, 'bot')
2019-01-15 22:57:19 [WARNING ] (13, 1, 'bot')
2019-01-15 22:57:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:57:19 [DEBUG   ] Finished updating board flags in 2.152 seconds
2019-01-15 22:57:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 22:57:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 22:58:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 22:58:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:58:19 [WARNING ] (13, 1, 'bot')
2019-01-15 22:58:19 [WARNING ] (13, 1, 'bot')
2019-01-15 22:58:19 [WARNING ] (13, 1, 'bot')
2019-01-15 22:58:19 [WARNING ] (13, 1, 'bot')
2019-01-15 22:58:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:58:19 [DEBUG   ] Finished updating board flags in 1.895 seconds
2019-01-15 22:58:28 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2019-01-15 22:58:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 22:59:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 22:59:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 22:59:19 [WARNING ] (13, 1, 'bot')
2019-01-15 22:59:19 [WARNING ] (13, 1, 'bot')
2019-01-15 22:59:19 [WARNING ] (13, 1, 'bot')
2019-01-15 22:59:19 [WARNING ] (13, 1, 'bot')
2019-01-15 22:59:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 22:59:19 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-01-15 22:59:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 22:59:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 23:00:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 23:00:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:00:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:00:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:00:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:00:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:00:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:00:19 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-15 23:00:28 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 23:00:48 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 23:01:05 [DEBUG   ] Got command RPT from MCS: ref #1179982
2019-01-15 23:01:05 [DEBUG   ] summary = ERROR
2019-01-15 23:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179982  13 58498 82865137 A  ERRORERROR'
2019-01-15 23:01:05 [DEBUG   ] Got command RPT from MCS: ref #1179983
2019-01-15 23:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179983  77 58498 82865138 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:01:09 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2019-01-15 23:01:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:01:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:01:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:01:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:01:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:01:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:01:19 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-01-15 23:01:29 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 23:01:29 [DEBUG   ] Got command RPT from MCS: ref #1179999
2019-01-15 23:01:29 [DEBUG   ] summary = ERROR
2019-01-15 23:01:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1179999  13 58498 82889549 A  ERRORERROR'
2019-01-15 23:01:29 [DEBUG   ] Got command RPT from MCS: ref #1180000
2019-01-15 23:01:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:01:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180000  77 58498 82889741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:01:29 [DEBUG   ] Got command RPT from MCS: ref #1180001
2019-01-15 23:01:29 [DEBUG   ] summary = ERROR
2019-01-15 23:01:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180001  13 58498 82889945 A  ERRORERROR'
2019-01-15 23:01:30 [DEBUG   ] Got command RPT from MCS: ref #1180002
2019-01-15 23:01:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:01:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180002  77 58498 82890149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:01:30 [DEBUG   ] Got command RPT from MCS: ref #1180003
2019-01-15 23:01:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 23:01:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180003  12 58498 82890353 A  ERRORB—™š'
2019-01-15 23:01:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 23:02:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 23:02:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:02:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:02:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:02:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:02:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:02:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:02:19 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-01-15 23:02:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 23:02:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 23:03:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 23:03:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:03:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:03:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:03:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:03:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:03:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:03:19 [DEBUG   ] Finished updating board flags in 1.594 seconds
2019-01-15 23:03:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 23:03:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 23:04:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 23:04:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:04:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:04:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:04:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:04:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:04:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:04:19 [DEBUG   ] Finished updating board flags in 1.405 seconds
2019-01-15 23:04:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 23:04:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 23:05:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 23:05:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:05:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:05:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:05:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:05:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:05:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:05:19 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-01-15 23:05:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 23:05:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 23:06:05 [DEBUG   ] Got command RPT from MCS: ref #1180012
2019-01-15 23:06:05 [DEBUG   ] summary = ERROR
2019-01-15 23:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180012  13 58498 83165129 A  ERRORERROR'
2019-01-15 23:06:05 [DEBUG   ] Got command RPT from MCS: ref #1180013
2019-01-15 23:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180013  77 58498 83165130 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:06:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 23:06:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:06:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:06:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:06:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:06:19 [WARNING ] (13, 1, 'bot')
2019-01-15 23:06:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:06:19 [DEBUG   ] Finished updating board flags in 1.384 seconds
2019-01-15 23:06:29 [DEBUG   ] Got command RPT from MCS: ref #1180031
2019-01-15 23:06:29 [DEBUG   ] summary = ERROR
2019-01-15 23:06:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180031  13 58498 83189621 A  ERRORERROR'
2019-01-15 23:06:29 [DEBUG   ] Got command RPT from MCS: ref #1180032
2019-01-15 23:06:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:06:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180032  77 58498 83189825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:06:30 [DEBUG   ] Got command RPT from MCS: ref #1180033
2019-01-15 23:06:30 [DEBUG   ] summary = ERROR
2019-01-15 23:06:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180033  13 58498 83190035 A  ERRORERROR'
2019-01-15 23:06:30 [DEBUG   ] Got command RPT from MCS: ref #1180035
2019-01-15 23:06:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:06:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180035  77 58498 83190225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:06:30 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 23:06:30 [DEBUG   ] Got command RPT from MCS: ref #1180036
2019-01-15 23:06:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 23:06:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180036  12 58498 83190429 A  ERRORB–™š'
2019-01-15 23:06:50 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 23:07:10 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-15 23:07:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:07:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 23:07:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:07:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:07:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:07:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:07:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:07:20 [DEBUG   ] Finished updating board flags in 2.025 seconds
2019-01-15 23:07:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 23:07:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 23:08:10 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 23:08:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:08:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:08:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:08:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:08:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:08:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:08:20 [DEBUG   ] Finished updating board flags in 2.008 seconds
2019-01-15 23:08:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 23:08:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 23:09:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 23:09:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:09:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:09:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:09:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:09:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:09:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:09:20 [DEBUG   ] Finished updating board flags in 1.996 seconds
2019-01-15 23:09:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 23:09:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 23:10:10 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 23:10:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:10:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:10:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:10:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:10:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:10:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:10:20 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-15 23:10:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 23:10:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 23:11:05 [DEBUG   ] Got command RPT from MCS: ref #1180045
2019-01-15 23:11:05 [DEBUG   ] summary = ERROR
2019-01-15 23:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180045  13 58498 83465141 A  ERRORERROR'
2019-01-15 23:11:05 [DEBUG   ] Got command RPT from MCS: ref #1180046
2019-01-15 23:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180046  77 58498 83465142 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:11:10 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-01-15 23:11:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:11:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:11:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:11:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:11:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:11:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:11:20 [DEBUG   ] Finished updating board flags in 1.788 seconds
2019-01-15 23:11:29 [DEBUG   ] Got command RPT from MCS: ref #1180062
2019-01-15 23:11:29 [DEBUG   ] summary = ERROR
2019-01-15 23:11:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180062  13 58498 83489705 A  ERRORERROR'
2019-01-15 23:11:29 [DEBUG   ] Got command RPT from MCS: ref #1180063
2019-01-15 23:11:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:11:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180063  77 58498 83489909 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:11:30 [DEBUG   ] Got command RPT from MCS: ref #1180064
2019-01-15 23:11:30 [DEBUG   ] summary = ERROR
2019-01-15 23:11:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180064  13 58498 83490101 A  ERRORERROR'
2019-01-15 23:11:30 [DEBUG   ] Got command RPT from MCS: ref #1180065
2019-01-15 23:11:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:11:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180065  77 58498 83490301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:11:30 [DEBUG   ] Got command RPT from MCS: ref #1180066
2019-01-15 23:11:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 23:11:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180066  12 58498 83490505 A  ERRORB–™š'
2019-01-15 23:11:31 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 23:11:51 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 23:12:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 23:12:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:12:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 23:12:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:12:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:12:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:12:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:12:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:12:20 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-01-15 23:12:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 23:12:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 23:13:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 23:13:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:13:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:13:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:13:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:13:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:13:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:13:20 [DEBUG   ] Finished updating board flags in 1.585 seconds
2019-01-15 23:13:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 23:13:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 23:14:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 23:14:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:14:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:14:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:14:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:14:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:14:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:14:20 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-01-15 23:14:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 23:14:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-15 23:15:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 23:15:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:15:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 23:15:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:15:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:15:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:15:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:15:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:15:20 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-01-15 23:15:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-15 23:15:51 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 23:16:05 [DEBUG   ] Got command RPT from MCS: ref #1180075
2019-01-15 23:16:05 [DEBUG   ] summary = ERROR
2019-01-15 23:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180075  13 58498 83765141 A  ERRORERROR'
2019-01-15 23:16:05 [DEBUG   ] Got command RPT from MCS: ref #1180076
2019-01-15 23:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180076  77 58498 83765142 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:16:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 23:16:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:16:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:16:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:16:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:16:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:16:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:16:20 [DEBUG   ] Finished updating board flags in 1.385 seconds
2019-01-15 23:16:29 [DEBUG   ] Got command RPT from MCS: ref #1180094
2019-01-15 23:16:29 [DEBUG   ] summary = ERROR
2019-01-15 23:16:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180094  13 58498 83789781 A  ERRORERROR'
2019-01-15 23:16:29 [DEBUG   ] Got command RPT from MCS: ref #1180095
2019-01-15 23:16:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:16:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180095  77 58498 83789985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:16:30 [DEBUG   ] Got command RPT from MCS: ref #1180096
2019-01-15 23:16:30 [DEBUG   ] summary = ERROR
2019-01-15 23:16:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180096  13 58498 83790189 A  ERRORERROR'
2019-01-15 23:16:30 [DEBUG   ] Got command RPT from MCS: ref #1180098
2019-01-15 23:16:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:16:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180098  77 58498 83790393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:16:30 [DEBUG   ] Got command RPT from MCS: ref #1180100
2019-01-15 23:16:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 23:16:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180100  12 58498 83790585 A  ERRORB•™š'
2019-01-15 23:16:31 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-15 23:16:51 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 23:17:12 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-15 23:17:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:17:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:17:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:17:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:17:20 [WARNING ] (13, 1, 'bot')
2019-01-15 23:17:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:17:20 [DEBUG   ] Finished updating board flags in 1.356 seconds
2019-01-15 23:17:32 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 23:17:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 23:18:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 23:18:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:18:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:18:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:18:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:18:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:18:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:18:21 [DEBUG   ] Finished updating board flags in 2.062 seconds
2019-01-15 23:18:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 23:18:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 23:19:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 23:19:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:19:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:19:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:19:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:19:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:19:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:19:21 [DEBUG   ] Finished updating board flags in 2.075 seconds
2019-01-15 23:19:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 23:19:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 23:20:12 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-15 23:20:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:20:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:20:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:20:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:20:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:20:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:20:21 [DEBUG   ] Finished updating board flags in 1.924 seconds
2019-01-15 23:20:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 23:20:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 23:21:05 [DEBUG   ] Got command RPT from MCS: ref #1180112
2019-01-15 23:21:05 [DEBUG   ] summary = ERROR
2019-01-15 23:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180112  13 58498 84065133 A  ERRORERROR'
2019-01-15 23:21:05 [DEBUG   ] Got command RPT from MCS: ref #1180113
2019-01-15 23:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180113  77 58498 84065134 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:21:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 23:21:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:21:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:21:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:21:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:21:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:21:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:21:21 [DEBUG   ] Finished updating board flags in 1.799 seconds
2019-01-15 23:21:29 [DEBUG   ] Got command RPT from MCS: ref #1180129
2019-01-15 23:21:29 [DEBUG   ] summary = ERROR
2019-01-15 23:21:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180129  13 58498 84089865 A  ERRORERROR'
2019-01-15 23:21:30 [DEBUG   ] Got command RPT from MCS: ref #1180130
2019-01-15 23:21:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:21:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180130  77 58498 84090069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:21:30 [DEBUG   ] Got command RPT from MCS: ref #1180131
2019-01-15 23:21:30 [DEBUG   ] summary = ERROR
2019-01-15 23:21:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180131  13 58498 84090273 A  ERRORERROR'
2019-01-15 23:21:30 [DEBUG   ] Got command RPT from MCS: ref #1180132
2019-01-15 23:21:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:21:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180132  77 58498 84090465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:21:30 [DEBUG   ] Got command RPT from MCS: ref #1180133
2019-01-15 23:21:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 23:21:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180133  12 58498 84090669 A  ERRORB•™š'
2019-01-15 23:21:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 23:21:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 23:22:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 23:22:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:22:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:22:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:22:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:22:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:22:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:22:21 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-01-15 23:22:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 23:22:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 23:23:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 23:23:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:23:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 23:23:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:23:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:23:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:23:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:23:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:23:21 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-01-15 23:23:32 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 23:23:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 23:24:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 23:24:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:24:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:24:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:24:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:24:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:24:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:24:21 [DEBUG   ] Finished updating board flags in 1.610 seconds
2019-01-15 23:24:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 23:24:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 23:25:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 23:25:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:25:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 23:25:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:25:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:25:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:25:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:25:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:25:21 [DEBUG   ] Finished updating board flags in 1.570 seconds
2019-01-15 23:25:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 23:25:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 23:26:05 [DEBUG   ] Got command RPT from MCS: ref #1180138
2019-01-15 23:26:05 [DEBUG   ] summary = ERROR
2019-01-15 23:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180138  13 58498 84365137 A  ERRORERROR'
2019-01-15 23:26:05 [DEBUG   ] Got command RPT from MCS: ref #1180139
2019-01-15 23:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180139  77 58498 84365138 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:26:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 23:26:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:26:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:26:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:26:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:26:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:26:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:26:21 [DEBUG   ] Finished updating board flags in 1.497 seconds
2019-01-15 23:26:29 [DEBUG   ] Got command RPT from MCS: ref #1180157
2019-01-15 23:26:29 [DEBUG   ] summary = ERROR
2019-01-15 23:26:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180157  13 58498 84389945 A  ERRORERROR'
2019-01-15 23:26:30 [DEBUG   ] Got command RPT from MCS: ref #1180158
2019-01-15 23:26:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:26:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180158  77 58498 84390149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:26:30 [DEBUG   ] Got command RPT from MCS: ref #1180159
2019-01-15 23:26:30 [DEBUG   ] summary = ERROR
2019-01-15 23:26:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180159  13 58498 84390353 A  ERRORERROR'
2019-01-15 23:26:30 [DEBUG   ] Got command RPT from MCS: ref #1180161
2019-01-15 23:26:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:26:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180161  77 58498 84390545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:26:30 [DEBUG   ] Got command RPT from MCS: ref #1180162
2019-01-15 23:26:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 23:26:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180162  12 58498 84390749 A  ERRORB”™š'
2019-01-15 23:26:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 23:26:52 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-15 23:27:12 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-15 23:27:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:27:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:27:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:27:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:27:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:27:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:27:21 [DEBUG   ] Finished updating board flags in 1.500 seconds
2019-01-15 23:27:33 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2019-01-15 23:27:53 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 23:28:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 23:28:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:28:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:28:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:28:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:28:21 [WARNING ] (13, 1, 'bot')
2019-01-15 23:28:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:28:21 [DEBUG   ] Finished updating board flags in 1.499 seconds
2019-01-15 23:28:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 23:28:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 23:29:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 23:29:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:29:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:29:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:29:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:29:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:29:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:29:22 [DEBUG   ] Finished updating board flags in 2.167 seconds
2019-01-15 23:29:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 23:29:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 23:30:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 23:30:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:30:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:30:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:30:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:30:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:30:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:30:22 [DEBUG   ] Finished updating board flags in 2.045 seconds
2019-01-15 23:30:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 23:30:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 23:31:05 [DEBUG   ] Got command RPT from MCS: ref #1180175
2019-01-15 23:31:05 [DEBUG   ] summary = ERROR
2019-01-15 23:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180175  13 58498 84665141 A  ERRORERROR'
2019-01-15 23:31:05 [DEBUG   ] Got command RPT from MCS: ref #1180176
2019-01-15 23:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180176  77 58498 84665142 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:31:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 23:31:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:31:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:31:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:31:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:31:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:31:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:31:22 [DEBUG   ] Finished updating board flags in 1.891 seconds
2019-01-15 23:31:30 [DEBUG   ] Got command RPT from MCS: ref #1180192
2019-01-15 23:31:30 [DEBUG   ] summary = ERROR
2019-01-15 23:31:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180192  13 58498 84690025 A  ERRORERROR'
2019-01-15 23:31:30 [DEBUG   ] Got command RPT from MCS: ref #1180193
2019-01-15 23:31:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:31:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180193  77 58498 84690229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:31:30 [DEBUG   ] Got command RPT from MCS: ref #1180194
2019-01-15 23:31:30 [DEBUG   ] summary = ERROR
2019-01-15 23:31:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180194  13 58498 84690433 A  ERRORERROR'
2019-01-15 23:31:30 [DEBUG   ] Got command RPT from MCS: ref #1180195
2019-01-15 23:31:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:31:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180195  77 58498 84690625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:31:30 [DEBUG   ] Got command RPT from MCS: ref #1180196
2019-01-15 23:31:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 23:31:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180196  12 58498 84690829 A  ERRORB”™š'
2019-01-15 23:31:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 23:31:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 23:32:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 23:32:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:32:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:32:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:32:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:32:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:32:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:32:22 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-01-15 23:32:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 23:32:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 23:33:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 23:33:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:33:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:33:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:33:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:33:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:33:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:33:22 [DEBUG   ] Finished updating board flags in 1.794 seconds
2019-01-15 23:33:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 23:33:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 23:34:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 23:34:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:34:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:34:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:34:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:34:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:34:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:34:22 [DEBUG   ] Finished updating board flags in 1.598 seconds
2019-01-15 23:34:34 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-15 23:34:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 23:35:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 23:35:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:35:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:35:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:35:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:35:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:35:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:35:22 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-01-15 23:35:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 23:35:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 23:36:05 [DEBUG   ] Got command RPT from MCS: ref #1180205
2019-01-15 23:36:05 [DEBUG   ] summary = ERROR
2019-01-15 23:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180205  13 58498 84965137 A  ERRORERROR'
2019-01-15 23:36:05 [DEBUG   ] Got command RPT from MCS: ref #1180206
2019-01-15 23:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180206  77 58498 84965138 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:36:14 [DEBUG   ] Finished updating ant stats in 1.190 seconds
2019-01-15 23:36:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:36:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-15 23:36:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:36:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:36:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:36:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:36:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:36:22 [DEBUG   ] Finished updating board flags in 1.390 seconds
2019-01-15 23:36:30 [DEBUG   ] Got command RPT from MCS: ref #1180224
2019-01-15 23:36:30 [DEBUG   ] summary = ERROR
2019-01-15 23:36:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180224  13 58498 84990109 A  ERRORERROR'
2019-01-15 23:36:30 [DEBUG   ] Got command RPT from MCS: ref #1180225
2019-01-15 23:36:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:36:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180225  77 58498 84990301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:36:30 [DEBUG   ] Got command RPT from MCS: ref #1180226
2019-01-15 23:36:30 [DEBUG   ] summary = ERROR
2019-01-15 23:36:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180226  13 58498 84990505 A  ERRORERROR'
2019-01-15 23:36:30 [DEBUG   ] Got command RPT from MCS: ref #1180227
2019-01-15 23:36:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:36:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180227  77 58498 84990709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:36:30 [DEBUG   ] Got command RPT from MCS: ref #1180229
2019-01-15 23:36:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 23:36:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180229  12 58498 84990914 A  ERRORB–™š'
2019-01-15 23:36:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 23:36:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 23:37:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 23:37:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:37:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:37:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:37:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:37:22 [WARNING ] (13, 1, 'bot')
2019-01-15 23:37:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:37:22 [DEBUG   ] Finished updating board flags in 1.358 seconds
2019-01-15 23:37:34 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 23:37:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 23:38:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 23:38:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:38:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 23:38:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:38:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:38:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:38:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:38:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:38:23 [DEBUG   ] Finished updating board flags in 2.058 seconds
2019-01-15 23:38:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 23:38:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 23:39:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 23:39:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:39:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:39:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:39:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:39:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:39:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:39:23 [DEBUG   ] Finished updating board flags in 1.990 seconds
2019-01-15 23:39:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 23:39:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 23:40:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 23:40:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:40:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 23:40:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:40:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:40:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:40:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:40:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:40:23 [DEBUG   ] Finished updating board flags in 1.868 seconds
2019-01-15 23:40:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 23:40:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 23:41:05 [DEBUG   ] Got command RPT from MCS: ref #1180238
2019-01-15 23:41:05 [DEBUG   ] summary = ERROR
2019-01-15 23:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180238  13 58498 85265141 A  ERRORERROR'
2019-01-15 23:41:05 [DEBUG   ] Got command RPT from MCS: ref #1180239
2019-01-15 23:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180239  77 58498 85265142 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:41:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 23:41:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:41:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:41:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:41:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:41:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:41:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:41:23 [DEBUG   ] Finished updating board flags in 1.741 seconds
2019-01-15 23:41:30 [DEBUG   ] Got command RPT from MCS: ref #1180255
2019-01-15 23:41:30 [DEBUG   ] summary = ERROR
2019-01-15 23:41:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180255  13 58498 85290185 A  ERRORERROR'
2019-01-15 23:41:30 [DEBUG   ] Got command RPT from MCS: ref #1180256
2019-01-15 23:41:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:41:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180256  77 58498 85290389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:41:30 [DEBUG   ] Got command RPT from MCS: ref #1180257
2019-01-15 23:41:30 [DEBUG   ] summary = ERROR
2019-01-15 23:41:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180257  13 58498 85290593 A  ERRORERROR'
2019-01-15 23:41:30 [DEBUG   ] Got command RPT from MCS: ref #1180258
2019-01-15 23:41:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:41:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180258  77 58498 85290785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:41:30 [DEBUG   ] Got command RPT from MCS: ref #1180259
2019-01-15 23:41:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 23:41:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180259  12 58498 85290989 A  ERRORB—™š'
2019-01-15 23:41:34 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-15 23:41:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 23:42:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 23:42:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:42:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:42:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:42:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:42:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:42:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:42:23 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-15 23:42:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 23:42:55 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2019-01-15 23:43:15 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-15 23:43:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:43:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:43:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:43:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:43:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:43:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:43:23 [DEBUG   ] Finished updating board flags in 1.583 seconds
2019-01-15 23:43:35 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-01-15 23:43:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-15 23:44:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 23:44:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:44:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-15 23:44:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:44:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:44:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:44:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:44:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:44:23 [DEBUG   ] Finished updating board flags in 1.424 seconds
2019-01-15 23:44:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 23:44:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-15 23:45:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 23:45:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:45:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:45:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:45:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:45:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:45:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:45:23 [DEBUG   ] Finished updating board flags in 1.372 seconds
2019-01-15 23:45:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 23:45:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 23:46:05 [DEBUG   ] Got command RPT from MCS: ref #1180268
2019-01-15 23:46:05 [DEBUG   ] summary = ERROR
2019-01-15 23:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180268  13 58498 85565145 A  ERRORERROR'
2019-01-15 23:46:05 [DEBUG   ] Got command RPT from MCS: ref #1180269
2019-01-15 23:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180269  77 58498 85565146 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:46:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 23:46:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:46:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:46:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:46:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:46:23 [WARNING ] (13, 1, 'bot')
2019-01-15 23:46:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:46:23 [DEBUG   ] Finished updating board flags in 1.366 seconds
2019-01-15 23:46:30 [DEBUG   ] Got command RPT from MCS: ref #1180287
2019-01-15 23:46:30 [DEBUG   ] summary = ERROR
2019-01-15 23:46:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180287  13 58498 85590261 A  ERRORERROR'
2019-01-15 23:46:30 [DEBUG   ] Got command RPT from MCS: ref #1180288
2019-01-15 23:46:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:46:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180288  77 58498 85590465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:46:30 [DEBUG   ] Got command RPT from MCS: ref #1180289
2019-01-15 23:46:30 [DEBUG   ] summary = ERROR
2019-01-15 23:46:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180289  13 58498 85590669 A  ERRORERROR'
2019-01-15 23:46:30 [DEBUG   ] Got command RPT from MCS: ref #1180291
2019-01-15 23:46:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:46:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180291  77 58498 85590861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:46:31 [DEBUG   ] Got command RPT from MCS: ref #1180292
2019-01-15 23:46:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 23:46:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180292  12 58498 85591065 A  ERRORB–™š'
2019-01-15 23:46:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 23:46:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 23:47:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 23:47:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:47:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-15 23:47:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:47:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:47:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:47:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:47:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:47:24 [DEBUG   ] Finished updating board flags in 2.058 seconds
2019-01-15 23:47:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 23:47:56 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 23:48:16 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 23:48:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:48:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:48:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:48:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:48:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:48:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:48:24 [DEBUG   ] Finished updating board flags in 1.990 seconds
2019-01-15 23:48:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-15 23:48:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 23:49:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 23:49:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:49:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:49:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:49:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:49:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:49:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:49:24 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-01-15 23:49:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-15 23:49:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 23:50:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-15 23:50:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:50:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:50:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:50:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:50:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:50:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:50:24 [DEBUG   ] Finished updating board flags in 1.847 seconds
2019-01-15 23:50:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 23:50:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-15 23:51:05 [DEBUG   ] Got command RPT from MCS: ref #1180305
2019-01-15 23:51:05 [DEBUG   ] summary = ERROR
2019-01-15 23:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180305  13 58498 85865145 A  ERRORERROR'
2019-01-15 23:51:05 [DEBUG   ] Got command RPT from MCS: ref #1180306
2019-01-15 23:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180306  77 58498 85865146 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:51:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-15 23:51:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:51:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:51:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:51:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:51:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:51:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:51:24 [DEBUG   ] Finished updating board flags in 1.745 seconds
2019-01-15 23:51:30 [DEBUG   ] Got command RPT from MCS: ref #1180322
2019-01-15 23:51:30 [DEBUG   ] summary = ERROR
2019-01-15 23:51:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180322  13 58498 85890341 A  ERRORERROR'
2019-01-15 23:51:30 [DEBUG   ] Got command RPT from MCS: ref #1180323
2019-01-15 23:51:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:51:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180323  77 58498 85890545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:51:30 [DEBUG   ] Got command RPT from MCS: ref #1180324
2019-01-15 23:51:30 [DEBUG   ] summary = ERROR
2019-01-15 23:51:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180324  13 58498 85890749 A  ERRORERROR'
2019-01-15 23:51:30 [DEBUG   ] Got command RPT from MCS: ref #1180325
2019-01-15 23:51:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:51:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180325  77 58498 85890941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:51:31 [DEBUG   ] Got command RPT from MCS: ref #1180326
2019-01-15 23:51:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 23:51:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180326  12 58498 85891145 A  ERRORB–™š'
2019-01-15 23:51:36 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2019-01-15 23:51:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-15 23:52:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-15 23:52:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:52:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:52:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:52:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:52:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:52:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:52:24 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-01-15 23:52:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 23:52:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-15 23:53:17 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-15 23:53:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:53:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:53:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:53:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:53:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:53:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:53:24 [DEBUG   ] Finished updating board flags in 1.585 seconds
2019-01-15 23:53:37 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-15 23:53:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 23:54:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 23:54:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:54:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:54:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:54:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:54:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:54:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:54:24 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-01-15 23:54:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-15 23:54:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-15 23:55:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-15 23:55:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:55:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:55:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:55:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:55:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:55:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:55:24 [DEBUG   ] Finished updating board flags in 1.457 seconds
2019-01-15 23:55:37 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-15 23:55:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-15 23:56:05 [DEBUG   ] Got command RPT from MCS: ref #1180331
2019-01-15 23:56:05 [DEBUG   ] summary = ERROR
2019-01-15 23:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180331  13 58498 86165141 A  ERRORERROR'
2019-01-15 23:56:05 [DEBUG   ] Got command RPT from MCS: ref #1180332
2019-01-15 23:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180332  77 58498 86165142 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:56:17 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-15 23:56:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:56:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:56:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:56:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:56:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:56:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:56:24 [DEBUG   ] Finished updating board flags in 1.438 seconds
2019-01-15 23:56:30 [DEBUG   ] Got command RPT from MCS: ref #1180350
2019-01-15 23:56:30 [DEBUG   ] summary = ERROR
2019-01-15 23:56:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180350  13 58498 86190425 A  ERRORERROR'
2019-01-15 23:56:30 [DEBUG   ] Got command RPT from MCS: ref #1180351
2019-01-15 23:56:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:56:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180351  77 58498 86190629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:56:30 [DEBUG   ] Got command RPT from MCS: ref #1180352
2019-01-15 23:56:30 [DEBUG   ] summary = ERROR
2019-01-15 23:56:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180352  13 58498 86190833 A  ERRORERROR'
2019-01-15 23:56:31 [DEBUG   ] Got command RPT from MCS: ref #1180354
2019-01-15 23:56:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-15 23:56:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180354  77 58498 86191025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-15 23:56:31 [DEBUG   ] Got command RPT from MCS: ref #1180355
2019-01-15 23:56:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-15 23:56:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180355  12 58498 86191229 A  ERRORB•™š'
2019-01-15 23:56:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 23:56:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-15 23:57:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-15 23:57:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:57:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:57:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:57:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:57:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:57:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:57:24 [DEBUG   ] Finished updating board flags in 1.435 seconds
2019-01-15 23:57:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-15 23:57:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-15 23:58:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-15 23:58:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:58:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:58:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:58:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:58:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:58:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:58:24 [DEBUG   ] Finished updating board flags in 1.435 seconds
2019-01-15 23:58:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-15 23:58:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-15 23:59:18 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-15 23:59:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-15 23:59:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:59:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:59:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:59:24 [WARNING ] (13, 1, 'bot')
2019-01-15 23:59:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-15 23:59:24 [DEBUG   ] Finished updating board flags in 1.430 seconds
2019-01-15 23:59:38 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-15 23:59:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 00:00:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 00:00:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:00:24 [WARNING ] (13, 1, 'bot')
2019-01-16 00:00:24 [WARNING ] (13, 1, 'bot')
2019-01-16 00:00:24 [WARNING ] (13, 1, 'bot')
2019-01-16 00:00:24 [WARNING ] (13, 1, 'bot')
2019-01-16 00:00:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:00:24 [DEBUG   ] Finished updating board flags in 1.435 seconds
2019-01-16 00:00:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 00:00:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 00:01:05 [DEBUG   ] Got command RPT from MCS: ref #1180368
2019-01-16 00:01:05 [DEBUG   ] summary = ERROR
2019-01-16 00:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180368  13 58499    65141 A  ERRORERROR'
2019-01-16 00:01:05 [DEBUG   ] Got command RPT from MCS: ref #1180369
2019-01-16 00:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180369  77 58499    65142 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:01:18 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-16 00:01:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:01:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:01:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:01:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:01:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:01:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:01:25 [DEBUG   ] Finished updating board flags in 2.258 seconds
2019-01-16 00:01:30 [DEBUG   ] Got command RPT from MCS: ref #1180385
2019-01-16 00:01:30 [DEBUG   ] summary = ERROR
2019-01-16 00:01:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180385  13 58499    90501 A  ERRORERROR'
2019-01-16 00:01:30 [DEBUG   ] Got command RPT from MCS: ref #1180386
2019-01-16 00:01:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:01:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180386  77 58499    90705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:01:30 [DEBUG   ] Got command RPT from MCS: ref #1180387
2019-01-16 00:01:30 [DEBUG   ] summary = ERROR
2019-01-16 00:01:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180387  13 58499    90909 A  ERRORERROR'
2019-01-16 00:01:31 [DEBUG   ] Got command RPT from MCS: ref #1180388
2019-01-16 00:01:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:01:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180388  77 58499    91113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:01:31 [DEBUG   ] Got command RPT from MCS: ref #1180389
2019-01-16 00:01:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 00:01:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180389  12 58499    91305 A  ERRORB”™š'
2019-01-16 00:01:38 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-16 00:01:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 00:02:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 00:02:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:02:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:02:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:02:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:02:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:02:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:02:25 [DEBUG   ] Finished updating board flags in 2.150 seconds
2019-01-16 00:02:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 00:02:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 00:03:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 00:03:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:03:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:03:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:03:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:03:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:03:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:03:25 [DEBUG   ] Finished updating board flags in 2.026 seconds
2019-01-16 00:03:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 00:03:58 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-16 00:04:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 00:04:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:04:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:04:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:04:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:04:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:04:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:04:25 [DEBUG   ] Finished updating board flags in 2.019 seconds
2019-01-16 00:04:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 00:04:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 00:05:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 00:05:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:05:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-16 00:05:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:05:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:05:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:05:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:05:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:05:25 [DEBUG   ] Finished updating board flags in 2.201 seconds
2019-01-16 00:05:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 00:05:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 00:06:05 [DEBUG   ] Got command RPT from MCS: ref #1180398
2019-01-16 00:06:05 [DEBUG   ] summary = ERROR
2019-01-16 00:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180398  13 58499   365145 A  ERRORERROR'
2019-01-16 00:06:05 [DEBUG   ] Got command RPT from MCS: ref #1180399
2019-01-16 00:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180399  77 58499   365146 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:06:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 00:06:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:06:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:06:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:06:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:06:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:06:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:06:25 [DEBUG   ] Finished updating board flags in 1.955 seconds
2019-01-16 00:06:30 [DEBUG   ] Got command RPT from MCS: ref #1180417
2019-01-16 00:06:30 [DEBUG   ] summary = ERROR
2019-01-16 00:06:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180417  13 58499   390581 A  ERRORERROR'
2019-01-16 00:06:30 [DEBUG   ] Got command RPT from MCS: ref #1180418
2019-01-16 00:06:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:06:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180418  77 58499   390785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:06:30 [DEBUG   ] Got command RPT from MCS: ref #1180419
2019-01-16 00:06:30 [DEBUG   ] summary = ERROR
2019-01-16 00:06:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180419  13 58499   390989 A  ERRORERROR'
2019-01-16 00:06:31 [DEBUG   ] Got command RPT from MCS: ref #1180421
2019-01-16 00:06:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:06:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180421  77 58499   391193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:06:31 [DEBUG   ] Got command RPT from MCS: ref #1180422
2019-01-16 00:06:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 00:06:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180422  12 58499   391385 A  ERRORB”™š'
2019-01-16 00:06:38 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-16 00:06:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 00:07:19 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-16 00:07:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:07:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:07:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:07:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:07:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:07:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:07:25 [DEBUG   ] Finished updating board flags in 1.817 seconds
2019-01-16 00:07:39 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-16 00:07:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 00:08:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 00:08:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:08:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:08:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:08:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:08:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:08:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:08:25 [DEBUG   ] Finished updating board flags in 1.792 seconds
2019-01-16 00:08:39 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-01-16 00:08:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 00:09:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 00:09:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:09:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:09:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:09:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:09:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:09:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:09:25 [DEBUG   ] Finished updating board flags in 1.600 seconds
2019-01-16 00:09:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 00:09:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-16 00:10:19 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-16 00:10:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:10:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:10:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:10:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:10:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:10:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:10:25 [DEBUG   ] Finished updating board flags in 1.595 seconds
2019-01-16 00:10:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 00:10:59 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-01-16 00:11:05 [DEBUG   ] Got command RPT from MCS: ref #1180431
2019-01-16 00:11:05 [DEBUG   ] summary = ERROR
2019-01-16 00:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180431  13 58499   665145 A  ERRORERROR'
2019-01-16 00:11:05 [DEBUG   ] Got command RPT from MCS: ref #1180432
2019-01-16 00:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180432  77 58499   665146 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:11:19 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-16 00:11:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:11:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:11:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:11:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:11:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:11:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:11:25 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-01-16 00:11:30 [DEBUG   ] Got command RPT from MCS: ref #1180448
2019-01-16 00:11:30 [DEBUG   ] summary = ERROR
2019-01-16 00:11:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180448  13 58499   690661 A  ERRORERROR'
2019-01-16 00:11:30 [DEBUG   ] Got command RPT from MCS: ref #1180449
2019-01-16 00:11:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:11:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180449  77 58499   690865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:11:31 [DEBUG   ] Got command RPT from MCS: ref #1180450
2019-01-16 00:11:31 [DEBUG   ] summary = ERROR
2019-01-16 00:11:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180450  13 58499   691069 A  ERRORERROR'
2019-01-16 00:11:31 [DEBUG   ] Got command RPT from MCS: ref #1180451
2019-01-16 00:11:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:11:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180451  77 58499   691273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:11:31 [DEBUG   ] Got command RPT from MCS: ref #1180452
2019-01-16 00:11:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 00:11:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180452  12 58499   691465 A  ERRORB“™š'
2019-01-16 00:11:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 00:11:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 00:12:20 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-16 00:12:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:12:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:12:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:12:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:12:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:12:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:12:25 [DEBUG   ] Finished updating board flags in 1.370 seconds
2019-01-16 00:12:40 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-16 00:13:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 00:13:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 00:13:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:13:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:13:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:13:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:13:25 [WARNING ] (13, 1, 'bot')
2019-01-16 00:13:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:13:25 [DEBUG   ] Finished updating board flags in 1.352 seconds
2019-01-16 00:13:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 00:14:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 00:14:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 00:14:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:14:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:14:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:14:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:14:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:14:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:14:26 [DEBUG   ] Finished updating board flags in 2.119 seconds
2019-01-16 00:14:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 00:15:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 00:15:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 00:15:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:15:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:15:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:15:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:15:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:15:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:15:26 [DEBUG   ] Finished updating board flags in 1.985 seconds
2019-01-16 00:15:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 00:16:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 00:16:05 [DEBUG   ] Got command RPT from MCS: ref #1180461
2019-01-16 00:16:05 [DEBUG   ] summary = ERROR
2019-01-16 00:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180461  13 58499   965145 A  ERRORERROR'
2019-01-16 00:16:05 [DEBUG   ] Got command RPT from MCS: ref #1180462
2019-01-16 00:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180462  77 58499   965146 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:16:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 00:16:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:16:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:16:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:16:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:16:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:16:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:16:26 [DEBUG   ] Finished updating board flags in 1.725 seconds
2019-01-16 00:16:30 [DEBUG   ] Got command RPT from MCS: ref #1180480
2019-01-16 00:16:30 [DEBUG   ] summary = ERROR
2019-01-16 00:16:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180480  13 58499   990745 A  ERRORERROR'
2019-01-16 00:16:30 [DEBUG   ] Got command RPT from MCS: ref #1180481
2019-01-16 00:16:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:16:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180481  77 58499   990949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:16:31 [DEBUG   ] Got command RPT from MCS: ref #1180482
2019-01-16 00:16:31 [DEBUG   ] summary = ERROR
2019-01-16 00:16:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180482  13 58499   991153 A  ERRORERROR'
2019-01-16 00:16:31 [DEBUG   ] Got command RPT from MCS: ref #1180484
2019-01-16 00:16:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:16:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180484  77 58499   991345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:16:31 [DEBUG   ] Got command RPT from MCS: ref #1180485
2019-01-16 00:16:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 00:16:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180485  12 58499   991549 A  ERRORB”™š'
2019-01-16 00:16:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 00:17:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 00:17:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 00:17:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:17:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:17:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:17:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:17:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:17:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:17:26 [DEBUG   ] Finished updating board flags in 1.653 seconds
2019-01-16 00:17:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 00:18:00 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-16 00:18:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 00:18:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:18:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-16 00:18:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:18:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:18:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:18:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:18:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:18:26 [DEBUG   ] Finished updating board flags in 1.537 seconds
2019-01-16 00:18:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 00:19:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 00:19:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 00:19:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:19:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:19:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:19:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:19:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:19:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:19:26 [DEBUG   ] Finished updating board flags in 1.484 seconds
2019-01-16 00:19:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 00:20:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 00:20:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-16 00:20:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-16 00:20:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:20:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:20:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:20:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:20:26 [WARNING ] (13, 1, 'bot')
2019-01-16 00:20:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:20:26 [DEBUG   ] Finished updating board flags in 1.483 seconds
2019-01-16 00:20:40 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-16 00:21:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 00:21:05 [DEBUG   ] Got command RPT from MCS: ref #1180498
2019-01-16 00:21:05 [DEBUG   ] summary = ERROR
2019-01-16 00:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180498  13 58499  1265153 A  ERRORERROR'
2019-01-16 00:21:05 [DEBUG   ] Got command RPT from MCS: ref #1180499
2019-01-16 00:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180499  77 58499  1265154 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:21:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 00:21:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:21:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:21:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:21:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:21:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:21:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:21:27 [DEBUG   ] Finished updating board flags in 2.254 seconds
2019-01-16 00:21:30 [DEBUG   ] Got command RPT from MCS: ref #1180515
2019-01-16 00:21:30 [DEBUG   ] summary = ERROR
2019-01-16 00:21:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180515  13 58499  1290829 A  ERRORERROR'
2019-01-16 00:21:31 [DEBUG   ] Got command RPT from MCS: ref #1180516
2019-01-16 00:21:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:21:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180516  77 58499  1291033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:21:31 [DEBUG   ] Got command RPT from MCS: ref #1180517
2019-01-16 00:21:31 [DEBUG   ] summary = ERROR
2019-01-16 00:21:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180517  13 58499  1291237 A  ERRORERROR'
2019-01-16 00:21:31 [DEBUG   ] Got command RPT from MCS: ref #1180518
2019-01-16 00:21:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:21:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180518  77 58499  1291429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:21:31 [DEBUG   ] Got command RPT from MCS: ref #1180519
2019-01-16 00:21:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 00:21:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180519  12 58499  1291633 A  ERRORB–™š'
2019-01-16 00:21:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 00:22:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 00:22:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 00:22:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 00:22:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:22:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:22:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:22:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:22:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:22:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:22:27 [DEBUG   ] Finished updating board flags in 2.204 seconds
2019-01-16 00:22:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 00:23:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 00:23:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 00:23:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:23:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:23:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:23:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:23:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:23:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:23:27 [DEBUG   ] Finished updating board flags in 2.302 seconds
2019-01-16 00:23:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 00:24:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 00:24:20 [DEBUG   ] Finished updating ant stats in 0.587 seconds
2019-01-16 00:24:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:24:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:24:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:24:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:24:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:24:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:24:27 [DEBUG   ] Finished updating board flags in 2.087 seconds
2019-01-16 00:24:41 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-16 00:25:01 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-16 00:25:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 00:25:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:25:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:25:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:25:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:25:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:25:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:25:27 [DEBUG   ] Finished updating board flags in 2.018 seconds
2019-01-16 00:25:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 00:26:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-16 00:26:05 [DEBUG   ] Got command RPT from MCS: ref #1180524
2019-01-16 00:26:05 [DEBUG   ] summary = ERROR
2019-01-16 00:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180524  13 58499  1565149 A  ERRORERROR'
2019-01-16 00:26:05 [DEBUG   ] Got command RPT from MCS: ref #1180525
2019-01-16 00:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180525  77 58499  1565150 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:26:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-16 00:26:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:26:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:26:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:26:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:26:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:26:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:26:27 [DEBUG   ] Finished updating board flags in 1.977 seconds
2019-01-16 00:26:30 [DEBUG   ] Got command RPT from MCS: ref #1180543
2019-01-16 00:26:30 [DEBUG   ] summary = ERROR
2019-01-16 00:26:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180543  13 58499  1590917 A  ERRORERROR'
2019-01-16 00:26:31 [DEBUG   ] Got command RPT from MCS: ref #1180544
2019-01-16 00:26:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:26:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180544  77 58499  1591121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:26:31 [DEBUG   ] Got command RPT from MCS: ref #1180545
2019-01-16 00:26:31 [DEBUG   ] summary = ERROR
2019-01-16 00:26:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180545  13 58499  1591313 A  ERRORERROR'
2019-01-16 00:26:31 [DEBUG   ] Got command RPT from MCS: ref #1180547
2019-01-16 00:26:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:26:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180547  77 58499  1591517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:26:31 [DEBUG   ] Got command RPT from MCS: ref #1180548
2019-01-16 00:26:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 00:26:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180548  12 58499  1591721 A  ERRORB–™š'
2019-01-16 00:26:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 00:27:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 00:27:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 00:27:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:27:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:27:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:27:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:27:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:27:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:27:27 [DEBUG   ] Finished updating board flags in 1.821 seconds
2019-01-16 00:27:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 00:28:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 00:28:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 00:28:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:28:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:28:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:28:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:28:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:28:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:28:27 [DEBUG   ] Finished updating board flags in 1.786 seconds
2019-01-16 00:28:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 00:29:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-16 00:29:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-16 00:29:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:29:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-16 00:29:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:29:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:29:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:29:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:29:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:29:27 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-01-16 00:29:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 00:30:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 00:30:21 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-01-16 00:30:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:30:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:30:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:30:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:30:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:30:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:30:27 [DEBUG   ] Finished updating board flags in 1.587 seconds
2019-01-16 00:30:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 00:31:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 00:31:05 [DEBUG   ] Got command RPT from MCS: ref #1180561
2019-01-16 00:31:05 [DEBUG   ] summary = ERROR
2019-01-16 00:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180561  13 58499  1865153 A  ERRORERROR'
2019-01-16 00:31:05 [DEBUG   ] Got command RPT from MCS: ref #1180562
2019-01-16 00:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180562  77 58499  1865154 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:31:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 00:31:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:31:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:31:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:31:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:31:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:31:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:31:27 [DEBUG   ] Finished updating board flags in 1.403 seconds
2019-01-16 00:31:31 [DEBUG   ] Got command RPT from MCS: ref #1180578
2019-01-16 00:31:31 [DEBUG   ] summary = ERROR
2019-01-16 00:31:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180578  13 58499  1891001 A  ERRORERROR'
2019-01-16 00:31:31 [DEBUG   ] Got command RPT from MCS: ref #1180579
2019-01-16 00:31:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:31:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180579  77 58499  1891205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:31:31 [DEBUG   ] Got command RPT from MCS: ref #1180580
2019-01-16 00:31:31 [DEBUG   ] summary = ERROR
2019-01-16 00:31:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180580  13 58499  1891409 A  ERRORERROR'
2019-01-16 00:31:31 [DEBUG   ] Got command RPT from MCS: ref #1180581
2019-01-16 00:31:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:31:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180581  77 58499  1891601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:31:31 [DEBUG   ] Got command RPT from MCS: ref #1180582
2019-01-16 00:31:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 00:31:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180582  12 58499  1891805 A  ERRORB•™š'
2019-01-16 00:31:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 00:32:01 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2019-01-16 00:32:21 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-01-16 00:32:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:32:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:32:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:32:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:32:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:32:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:32:27 [DEBUG   ] Finished updating board flags in 1.452 seconds
2019-01-16 00:32:42 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-01-16 00:33:02 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-16 00:33:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 00:33:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:33:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:33:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:33:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:33:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:33:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:33:27 [DEBUG   ] Finished updating board flags in 1.446 seconds
2019-01-16 00:33:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 00:34:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 00:34:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 00:34:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:34:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-16 00:34:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:34:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:34:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:34:27 [WARNING ] (13, 1, 'bot')
2019-01-16 00:34:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:34:27 [DEBUG   ] Finished updating board flags in 1.533 seconds
2019-01-16 00:34:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 00:35:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 00:35:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 00:35:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:35:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:35:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:35:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:35:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:35:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:35:28 [DEBUG   ] Finished updating board flags in 2.304 seconds
2019-01-16 00:35:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 00:36:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 00:36:05 [DEBUG   ] Got command RPT from MCS: ref #1180591
2019-01-16 00:36:05 [DEBUG   ] summary = ERROR
2019-01-16 00:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180591  13 58499  2165157 A  ERRORERROR'
2019-01-16 00:36:05 [DEBUG   ] Got command RPT from MCS: ref #1180592
2019-01-16 00:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180592  77 58499  2165158 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:36:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 00:36:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:36:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:36:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:36:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:36:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:36:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:36:28 [DEBUG   ] Finished updating board flags in 2.206 seconds
2019-01-16 00:36:31 [DEBUG   ] Got command RPT from MCS: ref #1180610
2019-01-16 00:36:31 [DEBUG   ] summary = ERROR
2019-01-16 00:36:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180610  13 58499  2191089 A  ERRORERROR'
2019-01-16 00:36:31 [DEBUG   ] Got command RPT from MCS: ref #1180611
2019-01-16 00:36:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:36:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180611  77 58499  2191281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:36:31 [DEBUG   ] Got command RPT from MCS: ref #1180612
2019-01-16 00:36:31 [DEBUG   ] summary = ERROR
2019-01-16 00:36:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180612  13 58499  2191485 A  ERRORERROR'
2019-01-16 00:36:31 [DEBUG   ] Got command RPT from MCS: ref #1180614
2019-01-16 00:36:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:36:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180614  77 58499  2191689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:36:31 [DEBUG   ] Got command RPT from MCS: ref #1180616
2019-01-16 00:36:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 00:36:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180616  12 58499  2191893 A  ERRORB•™š'
2019-01-16 00:36:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 00:37:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 00:37:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 00:37:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:37:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:37:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:37:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:37:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:37:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:37:28 [DEBUG   ] Finished updating board flags in 2.077 seconds
2019-01-16 00:37:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 00:38:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 00:38:22 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-16 00:38:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 00:38:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:38:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-16 00:38:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:38:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:38:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:38:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:38:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:38:28 [DEBUG   ] Finished updating board flags in 2.004 seconds
2019-01-16 00:38:42 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-16 00:39:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 00:39:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 00:39:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:39:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:39:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:39:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:39:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:39:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:39:28 [DEBUG   ] Finished updating board flags in 2.002 seconds
2019-01-16 00:39:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 00:40:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 00:40:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 00:40:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:40:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 00:40:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:40:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:40:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:40:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:40:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:40:28 [DEBUG   ] Finished updating board flags in 1.986 seconds
2019-01-16 00:40:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 00:41:02 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-16 00:41:05 [DEBUG   ] Got command RPT from MCS: ref #1180624
2019-01-16 00:41:05 [DEBUG   ] summary = ERROR
2019-01-16 00:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180624  13 58499  2465149 A  ERRORERROR'
2019-01-16 00:41:05 [DEBUG   ] Got command RPT from MCS: ref #1180625
2019-01-16 00:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180625  77 58499  2465150 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:41:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 00:41:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:41:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:41:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:41:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:41:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:41:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:41:28 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-16 00:41:31 [DEBUG   ] Got command RPT from MCS: ref #1180641
2019-01-16 00:41:31 [DEBUG   ] summary = ERROR
2019-01-16 00:41:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180641  13 58499  2491181 A  ERRORERROR'
2019-01-16 00:41:31 [DEBUG   ] Got command RPT from MCS: ref #1180642
2019-01-16 00:41:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:41:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180642  77 58499  2491373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:41:31 [DEBUG   ] Got command RPT from MCS: ref #1180643
2019-01-16 00:41:31 [DEBUG   ] summary = ERROR
2019-01-16 00:41:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180643  13 58499  2491577 A  ERRORERROR'
2019-01-16 00:41:31 [DEBUG   ] Got command RPT from MCS: ref #1180644
2019-01-16 00:41:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:41:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180644  77 58499  2491781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:41:31 [DEBUG   ] Got command RPT from MCS: ref #1180645
2019-01-16 00:41:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 00:41:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180645  12 58499  2491973 A  ERRORB—™š'
2019-01-16 00:41:42 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-16 00:42:03 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-16 00:42:23 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-16 00:42:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:42:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:42:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:42:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:42:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:42:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:42:28 [DEBUG   ] Finished updating board flags in 1.800 seconds
2019-01-16 00:42:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 00:43:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-16 00:43:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 00:43:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:43:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:43:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:43:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:43:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:43:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:43:28 [DEBUG   ] Finished updating board flags in 1.798 seconds
2019-01-16 00:43:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 00:44:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 00:44:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-16 00:44:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:44:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:44:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:44:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:44:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:44:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:44:28 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-01-16 00:44:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 00:45:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 00:45:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 00:45:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:45:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:45:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:45:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:45:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:45:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:45:28 [DEBUG   ] Finished updating board flags in 1.591 seconds
2019-01-16 00:45:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-16 00:46:00 [DEBUG   ] Got command TBN from MCS: ref #1180654
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547599562']
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547599562']
2019-01-16 00:46:00 [DEBUG   ] tbn = exited with status True, code 0x00
2019-01-16 00:46:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN  1180654   8 58499  2760937 A  ERROR'
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547599562']
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547599562']
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547599562']
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547599562']
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547599562']
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547599562']
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547599562']
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547599562']
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547599562']
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547599562']
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547599562']
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547599562']
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547599562']
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547599562']
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547599562']
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547599562']
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547599562']
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547599562']
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547599562']
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547599562']
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547599562']
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547599562']
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547599562']
2019-01-16 00:46:00 [DEBUG   ] spawn_process: at 2019-01-16 00:46:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547599562']
2019-01-16 00:46:00 [INFO    ] Finished spawning TBN in 0.052 s
2019-01-16 00:46:03 [DEBUG   ] Finished updating ant stats in 0.536 seconds
2019-01-16 00:46:05 [DEBUG   ] Got command RPT from MCS: ref #1180655
2019-01-16 00:46:05 [DEBUG   ] summary = ERROR
2019-01-16 00:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180655  13 58499  2765161 A  ERRORERROR'
2019-01-16 00:46:05 [DEBUG   ] Got command RPT from MCS: ref #1180656
2019-01-16 00:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180656  77 58499  2765162 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:46:23 [DEBUG   ] Finished updating ant stats in 0.465 seconds
2019-01-16 00:46:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:46:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:46:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:46:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:46:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:46:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:46:28 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-01-16 00:46:31 [DEBUG   ] Got command RPT from MCS: ref #1180674
2019-01-16 00:46:31 [DEBUG   ] summary = ERROR
2019-01-16 00:46:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180674  13 58499  2791261 A  ERRORERROR'
2019-01-16 00:46:31 [DEBUG   ] Got command RPT from MCS: ref #1180675
2019-01-16 00:46:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:46:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180675  77 58499  2791465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:46:31 [DEBUG   ] Got command RPT from MCS: ref #1180676
2019-01-16 00:46:31 [DEBUG   ] summary = ERROR
2019-01-16 00:46:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180676  13 58499  2791669 A  ERRORERROR'
2019-01-16 00:46:31 [DEBUG   ] Got command RPT from MCS: ref #1180678
2019-01-16 00:46:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:46:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180678  77 58499  2791861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:46:32 [DEBUG   ] Got command RPT from MCS: ref #1180679
2019-01-16 00:46:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 00:46:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180679  12 58499  2792065 A  ERRORB—™š'
2019-01-16 00:46:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 00:47:04 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-16 00:47:24 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-16 00:47:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:47:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:47:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:47:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:47:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:47:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:47:28 [DEBUG   ] Finished updating board flags in 1.395 seconds
2019-01-16 00:47:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 00:48:04 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-16 00:48:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 00:48:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:48:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:48:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:48:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:48:28 [WARNING ] (13, 1, 'bot')
2019-01-16 00:48:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:48:28 [DEBUG   ] Finished updating board flags in 1.350 seconds
2019-01-16 00:48:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 00:49:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 00:49:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 00:49:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:49:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:49:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:49:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:49:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:49:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:49:29 [DEBUG   ] Finished updating board flags in 2.068 seconds
2019-01-16 00:49:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 00:50:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 00:50:11 [DEBUG   ] Got command TBW from MCS: ref #1180689
2019-01-16 00:50:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-01-16 00:50:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1180689   8 58499  3011997 A  ERROR'
2019-01-16 00:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-01-16 00:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-01-16 00:50:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-01-16 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-01-16 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-01-16 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-01-16 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-01-16 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-01-16 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-01-16 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-01-16 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-01-16 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-01-16 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-01-16 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-01-16 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-01-16 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-01-16 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-01-16 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-01-16 00:50:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-01-16 00:50:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-01-16 00:50:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-01-16 00:50:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-01-16 00:50:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-01-16 00:50:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-01-16 00:50:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-01-16 00:50:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-01-16 00:50:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-01-16 00:50:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-01-16 00:50:15 [DEBUG   ] spawn_process: at 2019-01-16 00:50:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-01-16 00:50:15 [INFO    ] Finished spawning TBW
2019-01-16 00:50:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:50:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:50:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:50:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:50:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:50:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:50:29 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-01-16 00:51:05 [DEBUG   ] Got command RPT from MCS: ref #1180696
2019-01-16 00:51:05 [DEBUG   ] summary = ERROR
2019-01-16 00:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180696  13 58499  3065161 A  ERRORERROR'
2019-01-16 00:51:05 [DEBUG   ] Got command RPT from MCS: ref #1180697
2019-01-16 00:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180697  77 58499  3065162 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:51:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:51:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:51:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:51:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:51:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:51:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:51:29 [DEBUG   ] Finished updating board flags in 1.941 seconds
2019-01-16 00:51:31 [DEBUG   ] Got command RPT from MCS: ref #1180714
2019-01-16 00:51:31 [DEBUG   ] summary = ERROR
2019-01-16 00:51:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180714  13 58499  3091345 A  ERRORERROR'
2019-01-16 00:51:31 [DEBUG   ] Got command RPT from MCS: ref #1180715
2019-01-16 00:51:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:51:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180715  77 58499  3091549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:51:31 [DEBUG   ] Got command RPT from MCS: ref #1180716
2019-01-16 00:51:31 [DEBUG   ] summary = ERROR
2019-01-16 00:51:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180716  13 58499  3091753 A  ERRORERROR'
2019-01-16 00:51:31 [DEBUG   ] Got command RPT from MCS: ref #1180717
2019-01-16 00:51:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:51:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180717  77 58499  3091957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:51:32 [DEBUG   ] Got command RPT from MCS: ref #1180718
2019-01-16 00:51:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 00:51:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180718  12 58499  3092149 A  ERRORB–™š'
2019-01-16 00:52:03 [INFO    ] __waitForTBW - TBW finished in 108.253 s
2019-01-16 00:52:04 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-16 00:52:04 [INFO    ] Started antennas statistics background thread
2019-01-16 00:52:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547599926']
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547599926']
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547599926']
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547599926']
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547599926']
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547599926']
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547599926']
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547599926']
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547599926']
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547599926']
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547599926']
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547599926']
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547599926']
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547599926']
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547599926']
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547599926']
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547599926']
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547599926']
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547599926']
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547599926']
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547599926']
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547599926']
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547599926']
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547599926']
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547599926']
2019-01-16 00:52:04 [DEBUG   ] spawn_process: at 2019-01-16 00:52:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547599926']
2019-01-16 00:52:04 [INFO    ] Finished spawning TBN in 0.050 s
2019-01-16 00:52:24 [DEBUG   ] Finished updating ant stats in 0.466 seconds
2019-01-16 00:52:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:52:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:52:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:52:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:52:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:52:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:52:29 [DEBUG   ] Finished updating board flags in 1.994 seconds
2019-01-16 00:52:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 00:53:04 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-16 00:53:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 00:53:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:53:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:53:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:53:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:53:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:53:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:53:29 [DEBUG   ] Finished updating board flags in 1.645 seconds
2019-01-16 00:53:45 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-16 00:54:05 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-16 00:54:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 00:54:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:54:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:54:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:54:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:54:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:54:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:54:29 [DEBUG   ] Finished updating board flags in 1.602 seconds
2019-01-16 00:54:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 00:55:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 00:55:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 00:55:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:55:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:55:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:55:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:55:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:55:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:55:29 [DEBUG   ] Finished updating board flags in 1.593 seconds
2019-01-16 00:55:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 00:56:05 [DEBUG   ] Got command RPT from MCS: ref #1180727
2019-01-16 00:56:05 [DEBUG   ] summary = ERROR
2019-01-16 00:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180727  13 58499  3365153 A  ERRORERROR'
2019-01-16 00:56:05 [DEBUG   ] Got command RPT from MCS: ref #1180728
2019-01-16 00:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180728  77 58499  3365154 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:56:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 00:56:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 00:56:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:56:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:56:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:56:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:56:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:56:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:56:29 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-01-16 00:56:31 [DEBUG   ] Got command RPT from MCS: ref #1180746
2019-01-16 00:56:31 [DEBUG   ] summary = ERROR
2019-01-16 00:56:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180746  13 58499  3391437 A  ERRORERROR'
2019-01-16 00:56:31 [DEBUG   ] Got command RPT from MCS: ref #1180747
2019-01-16 00:56:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:56:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180747  77 58499  3391641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:56:31 [DEBUG   ] Got command RPT from MCS: ref #1180748
2019-01-16 00:56:31 [DEBUG   ] summary = ERROR
2019-01-16 00:56:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180748  13 58499  3391833 A  ERRORERROR'
2019-01-16 00:56:32 [DEBUG   ] Got command RPT from MCS: ref #1180750
2019-01-16 00:56:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 00:56:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180750  77 58499  3392037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 00:56:32 [DEBUG   ] Got command RPT from MCS: ref #1180751
2019-01-16 00:56:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 00:56:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180751  12 58499  3392241 A  ERRORB–™š'
2019-01-16 00:56:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 00:57:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 00:57:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 00:57:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:57:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:57:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:57:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:57:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:57:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:57:29 [DEBUG   ] Finished updating board flags in 1.383 seconds
2019-01-16 00:57:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 00:58:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 00:58:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 00:58:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:58:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:58:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:58:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:58:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:58:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:58:29 [DEBUG   ] Finished updating board flags in 1.401 seconds
2019-01-16 00:58:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 00:59:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 00:59:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 00:59:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 00:59:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:59:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:59:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:59:29 [WARNING ] (13, 1, 'bot')
2019-01-16 00:59:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 00:59:29 [DEBUG   ] Finished updating board flags in 1.558 seconds
2019-01-16 00:59:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 01:00:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 01:00:25 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-16 01:00:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:00:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:00:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:00:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:00:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:00:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:00:30 [DEBUG   ] Finished updating board flags in 2.182 seconds
2019-01-16 01:00:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 01:01:05 [DEBUG   ] Got command RPT from MCS: ref #1180764
2019-01-16 01:01:05 [DEBUG   ] summary = ERROR
2019-01-16 01:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180764  13 58499  3665165 A  ERRORERROR'
2019-01-16 01:01:05 [DEBUG   ] Got command RPT from MCS: ref #1180765
2019-01-16 01:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180765  77 58499  3665166 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:01:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 01:01:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 01:01:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:01:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-16 01:01:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:01:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:01:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:01:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:01:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:01:30 [DEBUG   ] Finished updating board flags in 1.873 seconds
2019-01-16 01:01:31 [DEBUG   ] Got command RPT from MCS: ref #1180781
2019-01-16 01:01:31 [DEBUG   ] summary = ERROR
2019-01-16 01:01:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180781  13 58499  3691525 A  ERRORERROR'
2019-01-16 01:01:31 [DEBUG   ] Got command RPT from MCS: ref #1180782
2019-01-16 01:01:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:01:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180782  77 58499  3691717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:01:31 [DEBUG   ] Got command RPT from MCS: ref #1180783
2019-01-16 01:01:31 [DEBUG   ] summary = ERROR
2019-01-16 01:01:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180783  13 58499  3691921 A  ERRORERROR'
2019-01-16 01:01:32 [DEBUG   ] Got command RPT from MCS: ref #1180784
2019-01-16 01:01:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:01:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180784  77 58499  3692125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:01:32 [DEBUG   ] Got command RPT from MCS: ref #1180785
2019-01-16 01:01:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 01:01:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180785  12 58499  3692329 A  ERRORB•™š'
2019-01-16 01:01:45 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-16 01:02:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 01:02:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 01:02:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:02:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:02:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:02:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:02:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:02:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:02:30 [DEBUG   ] Finished updating board flags in 1.804 seconds
2019-01-16 01:02:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 01:03:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 01:03:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 01:03:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:03:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:03:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:03:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:03:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:03:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:03:30 [DEBUG   ] Finished updating board flags in 1.805 seconds
2019-01-16 01:03:45 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-16 01:04:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 01:04:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 01:04:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:04:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:04:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:04:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:04:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:04:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:04:30 [DEBUG   ] Finished updating board flags in 2.125 seconds
2019-01-16 01:04:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 01:05:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 01:05:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 01:05:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:05:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:05:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:05:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:05:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:05:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:05:30 [DEBUG   ] Finished updating board flags in 1.670 seconds
2019-01-16 01:05:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 01:06:05 [DEBUG   ] Got command RPT from MCS: ref #1180799
2019-01-16 01:06:05 [DEBUG   ] summary = ERROR
2019-01-16 01:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180799  13 58499  3965165 A  ERRORERROR'
2019-01-16 01:06:05 [DEBUG   ] Got command RPT from MCS: ref #1180800
2019-01-16 01:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180800  77 58499  3965166 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:06:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 01:06:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-16 01:06:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:06:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:06:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:06:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:06:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:06:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:06:30 [DEBUG   ] Finished updating board flags in 1.623 seconds
2019-01-16 01:06:31 [DEBUG   ] Got command RPT from MCS: ref #1180818
2019-01-16 01:06:31 [DEBUG   ] summary = ERROR
2019-01-16 01:06:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180818  13 58499  3991609 A  ERRORERROR'
2019-01-16 01:06:31 [DEBUG   ] Got command RPT from MCS: ref #1180819
2019-01-16 01:06:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:06:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180819  77 58499  3991813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:06:32 [DEBUG   ] Got command RPT from MCS: ref #1180820
2019-01-16 01:06:32 [DEBUG   ] summary = ERROR
2019-01-16 01:06:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180820  13 58499  3992005 A  ERRORERROR'
2019-01-16 01:06:32 [DEBUG   ] Got command RPT from MCS: ref #1180822
2019-01-16 01:06:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:06:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180822  77 58499  3992209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:06:32 [DEBUG   ] Got command RPT from MCS: ref #1180824
2019-01-16 01:06:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 01:06:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180824  12 58499  3992413 A  ERRORB–™š'
2019-01-16 01:06:45 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-16 01:07:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 01:07:26 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-16 01:07:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:07:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:07:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:07:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:07:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:07:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:07:30 [DEBUG   ] Finished updating board flags in 1.586 seconds
2019-01-16 01:07:46 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-16 01:08:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 01:08:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 01:08:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 01:08:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:08:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-16 01:08:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:08:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:08:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:08:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:08:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:08:30 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-01-16 01:08:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 01:09:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 01:09:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 01:09:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:09:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:09:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:09:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:09:30 [WARNING ] (13, 1, 'bot')
2019-01-16 01:09:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:09:30 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-01-16 01:09:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 01:10:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 01:10:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-16 01:10:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:10:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:10:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:10:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:10:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:10:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:10:31 [DEBUG   ] Finished updating board flags in 2.254 seconds
2019-01-16 01:10:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 01:11:05 [DEBUG   ] Got command RPT from MCS: ref #1180837
2019-01-16 01:11:05 [DEBUG   ] summary = ERROR
2019-01-16 01:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180837  13 58499  4265165 A  ERRORERROR'
2019-01-16 01:11:05 [DEBUG   ] Got command RPT from MCS: ref #1180838
2019-01-16 01:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180838  77 58499  4265166 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:11:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 01:11:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 01:11:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:11:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:11:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:11:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:11:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:11:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:11:31 [DEBUG   ] Finished updating board flags in 2.144 seconds
2019-01-16 01:11:31 [DEBUG   ] Got command RPT from MCS: ref #1180854
2019-01-16 01:11:31 [DEBUG   ] summary = ERROR
2019-01-16 01:11:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180854  13 58499  4291701 A  ERRORERROR'
2019-01-16 01:11:31 [DEBUG   ] Got command RPT from MCS: ref #1180855
2019-01-16 01:11:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:11:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180855  77 58499  4291893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:11:32 [DEBUG   ] Got command RPT from MCS: ref #1180856
2019-01-16 01:11:32 [DEBUG   ] summary = ERROR
2019-01-16 01:11:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180856  13 58499  4292097 A  ERRORERROR'
2019-01-16 01:11:32 [DEBUG   ] Got command RPT from MCS: ref #1180857
2019-01-16 01:11:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:11:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180857  77 58499  4292301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:11:32 [DEBUG   ] Got command RPT from MCS: ref #1180858
2019-01-16 01:11:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 01:11:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180858  12 58499  4292505 A  ERRORB—™š'
2019-01-16 01:11:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 01:12:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 01:12:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 01:12:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:12:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:12:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:12:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:12:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:12:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:12:31 [DEBUG   ] Finished updating board flags in 2.031 seconds
2019-01-16 01:12:46 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-16 01:13:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 01:13:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 01:13:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:13:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 01:13:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:13:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:13:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:13:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:13:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:13:31 [DEBUG   ] Finished updating board flags in 1.979 seconds
2019-01-16 01:13:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 01:14:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 01:14:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 01:14:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-16 01:14:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:14:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:14:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:14:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:14:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:14:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:14:31 [DEBUG   ] Finished updating board flags in 1.868 seconds
2019-01-16 01:14:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 01:15:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 01:15:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 01:15:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:15:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:15:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:15:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:15:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:15:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:15:31 [DEBUG   ] Finished updating board flags in 1.827 seconds
2019-01-16 01:15:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 01:16:05 [DEBUG   ] Got command RPT from MCS: ref #1180867
2019-01-16 01:16:05 [DEBUG   ] summary = ERROR
2019-01-16 01:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180867  13 58499  4565169 A  ERRORERROR'
2019-01-16 01:16:05 [DEBUG   ] Got command RPT from MCS: ref #1180868
2019-01-16 01:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180868  77 58499  4565170 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:16:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 01:16:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 01:16:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:16:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:16:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:16:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:16:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:16:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:16:31 [DEBUG   ] Finished updating board flags in 1.702 seconds
2019-01-16 01:16:31 [DEBUG   ] Got command RPT from MCS: ref #1180886
2019-01-16 01:16:31 [DEBUG   ] summary = ERROR
2019-01-16 01:16:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180886  13 58499  4591781 A  ERRORERROR'
2019-01-16 01:16:31 [DEBUG   ] Got command RPT from MCS: ref #1180887
2019-01-16 01:16:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:16:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180887  77 58499  4591985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:16:32 [DEBUG   ] Got command RPT from MCS: ref #1180888
2019-01-16 01:16:32 [DEBUG   ] summary = ERROR
2019-01-16 01:16:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180888  13 58499  4592189 A  ERRORERROR'
2019-01-16 01:16:32 [DEBUG   ] Got command RPT from MCS: ref #1180890
2019-01-16 01:16:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:16:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180890  77 58499  4592381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:16:32 [DEBUG   ] Got command RPT from MCS: ref #1180892
2019-01-16 01:16:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 01:16:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180892  12 58499  4592585 A  ERRORB˜™š'
2019-01-16 01:16:46 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-16 01:17:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 01:17:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 01:17:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:17:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 01:17:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:17:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:17:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:17:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:17:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:17:31 [DEBUG   ] Finished updating board flags in 1.616 seconds
2019-01-16 01:17:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 01:18:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 01:18:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 01:18:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:18:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 01:18:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:18:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:18:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:18:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:18:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:18:31 [DEBUG   ] Finished updating board flags in 1.627 seconds
2019-01-16 01:18:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 01:19:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 01:19:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 01:19:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:19:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:19:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:19:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:19:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:19:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:19:31 [DEBUG   ] Finished updating board flags in 1.576 seconds
2019-01-16 01:19:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 01:20:06 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-16 01:20:27 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-16 01:20:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:20:31 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 01:20:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:20:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:20:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:20:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:20:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:20:31 [DEBUG   ] Finished updating board flags in 1.437 seconds
2019-01-16 01:20:47 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-16 01:21:05 [DEBUG   ] Got command RPT from MCS: ref #1180904
2019-01-16 01:21:05 [DEBUG   ] summary = ERROR
2019-01-16 01:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180904  13 58499  4865165 A  ERRORERROR'
2019-01-16 01:21:05 [DEBUG   ] Got command RPT from MCS: ref #1180905
2019-01-16 01:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180905  77 58499  4865166 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:21:07 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-16 01:21:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 01:21:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 01:21:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:21:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:21:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:21:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:21:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:21:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:21:31 [DEBUG   ] Finished updating board flags in 1.432 seconds
2019-01-16 01:21:31 [DEBUG   ] Got command RPT from MCS: ref #1180921
2019-01-16 01:21:31 [DEBUG   ] summary = ERROR
2019-01-16 01:21:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180921  13 58499  4891865 A  ERRORERROR'
2019-01-16 01:21:32 [DEBUG   ] Got command RPT from MCS: ref #1180922
2019-01-16 01:21:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:21:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180922  77 58499  4892069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:21:32 [DEBUG   ] Got command RPT from MCS: ref #1180923
2019-01-16 01:21:32 [DEBUG   ] summary = ERROR
2019-01-16 01:21:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180923  13 58499  4892273 A  ERRORERROR'
2019-01-16 01:21:32 [DEBUG   ] Got command RPT from MCS: ref #1180924
2019-01-16 01:21:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:21:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180924  77 58499  4892465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:21:32 [DEBUG   ] Got command RPT from MCS: ref #1180925
2019-01-16 01:21:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 01:21:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180925  12 58499  4892669 A  ERRORB™™š'
2019-01-16 01:21:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 01:22:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 01:22:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 01:22:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:22:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:22:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:22:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:22:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:22:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:22:31 [DEBUG   ] Finished updating board flags in 1.441 seconds
2019-01-16 01:22:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 01:23:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 01:23:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 01:23:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 01:23:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:23:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:23:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:23:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:23:31 [WARNING ] (13, 1, 'bot')
2019-01-16 01:23:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:23:31 [DEBUG   ] Finished updating board flags in 1.513 seconds
2019-01-16 01:23:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 01:24:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 01:24:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 01:24:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 01:24:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:24:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:24:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:24:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:24:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:24:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:24:32 [DEBUG   ] Finished updating board flags in 2.254 seconds
2019-01-16 01:24:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 01:25:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 01:25:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-16 01:25:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:25:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 01:25:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:25:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:25:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:25:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:25:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:25:32 [DEBUG   ] Finished updating board flags in 2.129 seconds
2019-01-16 01:25:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 01:26:05 [DEBUG   ] Got command RPT from MCS: ref #1180930
2019-01-16 01:26:05 [DEBUG   ] summary = ERROR
2019-01-16 01:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180930  13 58499  5165161 A  ERRORERROR'
2019-01-16 01:26:05 [DEBUG   ] Got command RPT from MCS: ref #1180931
2019-01-16 01:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180931  77 58499  5165162 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:26:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 01:26:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 01:26:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:26:31 [DEBUG   ] Got command RPT from MCS: ref #1180949
2019-01-16 01:26:31 [DEBUG   ] summary = ERROR
2019-01-16 01:26:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180949  13 58499  5191953 A  ERRORERROR'
2019-01-16 01:26:32 [DEBUG   ] Got command RPT from MCS: ref #1180950
2019-01-16 01:26:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:26:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180950  77 58499  5192157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:26:32 [DEBUG   ] Got command RPT from MCS: ref #1180951
2019-01-16 01:26:32 [DEBUG   ] summary = ERROR
2019-01-16 01:26:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180951  13 58499  5192349 A  ERRORERROR'
2019-01-16 01:26:32 [DEBUG   ] Got command RPT from MCS: ref #1180952
2019-01-16 01:26:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:26:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180952  77 58499  5192553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:26:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:26:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:26:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:26:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:26:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:26:32 [DEBUG   ] Finished updating board flags in 2.014 seconds
2019-01-16 01:26:32 [DEBUG   ] Got command RPT from MCS: ref #1180954
2019-01-16 01:26:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 01:26:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180954  12 58499  5192757 A  ERRORB™™š'
2019-01-16 01:26:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 01:27:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 01:27:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 01:27:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 01:27:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:27:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:27:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:27:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:27:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:27:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:27:32 [DEBUG   ] Finished updating board flags in 2.005 seconds
2019-01-16 01:27:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 01:28:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 01:28:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 01:28:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:28:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:28:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:28:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:28:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:28:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:28:32 [DEBUG   ] Finished updating board flags in 2.026 seconds
2019-01-16 01:28:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 01:29:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 01:29:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 01:29:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:29:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 01:29:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:29:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:29:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:29:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:29:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:29:32 [DEBUG   ] Finished updating board flags in 2.016 seconds
2019-01-16 01:29:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 01:30:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 01:30:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 01:30:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:30:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 01:30:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:30:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:30:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:30:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:30:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:30:32 [DEBUG   ] Finished updating board flags in 1.985 seconds
2019-01-16 01:30:47 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-16 01:31:05 [DEBUG   ] Got command RPT from MCS: ref #1180967
2019-01-16 01:31:05 [DEBUG   ] summary = ERROR
2019-01-16 01:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180967  13 58499  5465165 A  ERRORERROR'
2019-01-16 01:31:05 [DEBUG   ] Got command RPT from MCS: ref #1180968
2019-01-16 01:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180968  77 58499  5465166 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:31:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 01:31:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 01:31:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:31:32 [DEBUG   ] Got command RPT from MCS: ref #1180984
2019-01-16 01:31:32 [DEBUG   ] summary = ERROR
2019-01-16 01:31:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180984  13 58499  5492041 A  ERRORERROR'
2019-01-16 01:31:32 [DEBUG   ] Got command RPT from MCS: ref #1180985
2019-01-16 01:31:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:31:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180985  77 58499  5492237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:31:32 [DEBUG   ] Got command RPT from MCS: ref #1180986
2019-01-16 01:31:32 [DEBUG   ] summary = ERROR
2019-01-16 01:31:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180986  13 58499  5492441 A  ERRORERROR'
2019-01-16 01:31:32 [DEBUG   ] Got command RPT from MCS: ref #1180987
2019-01-16 01:31:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:31:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180987  77 58499  5492645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:31:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:31:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:31:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:31:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:31:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:31:32 [DEBUG   ] Finished updating board flags in 1.757 seconds
2019-01-16 01:31:32 [DEBUG   ] Got command RPT from MCS: ref #1180988
2019-01-16 01:31:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 01:31:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180988  12 58499  5492837 A  ERRORB™™š'
2019-01-16 01:31:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 01:32:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-16 01:32:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 01:32:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:32:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:32:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:32:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:32:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:32:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:32:32 [DEBUG   ] Finished updating board flags in 1.582 seconds
2019-01-16 01:32:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 01:33:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 01:33:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 01:33:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-16 01:33:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:33:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 01:33:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:33:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:33:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:33:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:33:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:33:32 [DEBUG   ] Finished updating board flags in 1.431 seconds
2019-01-16 01:33:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 01:34:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 01:34:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 01:34:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:34:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 01:34:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:34:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:34:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:34:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:34:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:34:32 [DEBUG   ] Finished updating board flags in 1.383 seconds
2019-01-16 01:34:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 01:35:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 01:35:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 01:35:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:35:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:35:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:35:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:35:32 [WARNING ] (13, 1, 'bot')
2019-01-16 01:35:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:35:32 [DEBUG   ] Finished updating board flags in 1.382 seconds
2019-01-16 01:35:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 01:36:05 [DEBUG   ] Got command RPT from MCS: ref #1180997
2019-01-16 01:36:05 [DEBUG   ] summary = ERROR
2019-01-16 01:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180997  13 58499  5765165 A  ERRORERROR'
2019-01-16 01:36:05 [DEBUG   ] Got command RPT from MCS: ref #1180998
2019-01-16 01:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1180998  77 58499  5765166 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:36:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 01:36:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 01:36:32 [DEBUG   ] Got command RPT from MCS: ref #1181016
2019-01-16 01:36:32 [DEBUG   ] summary = ERROR
2019-01-16 01:36:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181016  13 58499  5792121 A  ERRORERROR'
2019-01-16 01:36:32 [DEBUG   ] Got command RPT from MCS: ref #1181017
2019-01-16 01:36:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:36:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181017  77 58499  5792326 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:36:32 [DEBUG   ] Got command RPT from MCS: ref #1181018
2019-01-16 01:36:32 [DEBUG   ] summary = ERROR
2019-01-16 01:36:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181018  13 58499  5792529 A  ERRORERROR'
2019-01-16 01:36:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:36:32 [DEBUG   ] Got command RPT from MCS: ref #1181020
2019-01-16 01:36:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:36:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181020  77 58499  5792730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:36:32 [DEBUG   ] Got command RPT from MCS: ref #1181021
2019-01-16 01:36:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 01:36:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181021  12 58499  5792933 A  ERRORB�ÌÍ'
2019-01-16 01:36:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:36:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:36:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:36:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:36:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:36:33 [DEBUG   ] Finished updating board flags in 2.126 seconds
2019-01-16 01:36:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 01:37:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 01:37:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 01:37:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:37:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:37:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:37:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:37:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:37:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:37:33 [DEBUG   ] Finished updating board flags in 1.909 seconds
2019-01-16 01:37:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 01:38:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 01:38:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 01:38:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 01:38:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:38:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 01:38:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:38:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:38:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:38:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:38:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:38:33 [DEBUG   ] Finished updating board flags in 1.839 seconds
2019-01-16 01:38:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 01:39:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 01:39:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 01:39:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:39:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:39:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:39:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:39:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:39:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:39:33 [DEBUG   ] Finished updating board flags in 1.757 seconds
2019-01-16 01:39:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 01:40:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 01:40:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 01:40:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:40:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 01:40:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:40:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:40:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:40:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:40:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:40:33 [DEBUG   ] Finished updating board flags in 1.622 seconds
2019-01-16 01:40:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 01:41:05 [DEBUG   ] Got command RPT from MCS: ref #1181030
2019-01-16 01:41:05 [DEBUG   ] summary = ERROR
2019-01-16 01:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181030  13 58499  6065165 A  ERRORERROR'
2019-01-16 01:41:05 [DEBUG   ] Got command RPT from MCS: ref #1181031
2019-01-16 01:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181031  77 58499  6065166 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:41:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 01:41:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 01:41:32 [DEBUG   ] Got command RPT from MCS: ref #1181047
2019-01-16 01:41:32 [DEBUG   ] summary = ERROR
2019-01-16 01:41:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181047  13 58499  6092213 A  ERRORERROR'
2019-01-16 01:41:32 [DEBUG   ] Got command RPT from MCS: ref #1181048
2019-01-16 01:41:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:41:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181048  77 58499  6092410 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:41:32 [DEBUG   ] Got command RPT from MCS: ref #1181049
2019-01-16 01:41:32 [DEBUG   ] summary = ERROR
2019-01-16 01:41:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181049  13 58499  6092613 A  ERRORERROR'
2019-01-16 01:41:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:41:32 [DEBUG   ] Got command RPT from MCS: ref #1181050
2019-01-16 01:41:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:41:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181050  77 58499  6092817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:41:33 [DEBUG   ] Got command RPT from MCS: ref #1181051
2019-01-16 01:41:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 01:41:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181051  12 58499  6093021 A  ERRORBŽÌÍ'
2019-01-16 01:41:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:41:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:41:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:41:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:41:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:41:33 [DEBUG   ] Finished updating board flags in 1.685 seconds
2019-01-16 01:41:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 01:42:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 01:42:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 01:42:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:42:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:42:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:42:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:42:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:42:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:42:33 [DEBUG   ] Finished updating board flags in 1.496 seconds
2019-01-16 01:42:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 01:43:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 01:43:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 01:43:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:43:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:43:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:43:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:43:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:43:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:43:33 [DEBUG   ] Finished updating board flags in 1.504 seconds
2019-01-16 01:43:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-16 01:44:07 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-16 01:44:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 01:44:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:44:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:44:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:44:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:44:33 [WARNING ] (13, 1, 'bot')
2019-01-16 01:44:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:44:33 [DEBUG   ] Finished updating board flags in 1.506 seconds
2019-01-16 01:44:47 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-16 01:45:08 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-16 01:45:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 01:45:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:45:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:45:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:45:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:45:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:45:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:45:34 [DEBUG   ] Finished updating board flags in 2.010 seconds
2019-01-16 01:45:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 01:46:05 [DEBUG   ] Got command RPT from MCS: ref #1181060
2019-01-16 01:46:05 [DEBUG   ] summary = ERROR
2019-01-16 01:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181060  13 58499  6365169 A  ERRORERROR'
2019-01-16 01:46:05 [DEBUG   ] Got command RPT from MCS: ref #1181061
2019-01-16 01:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181061  77 58499  6365170 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:46:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 01:46:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-16 01:46:32 [DEBUG   ] Got command RPT from MCS: ref #1181079
2019-01-16 01:46:32 [DEBUG   ] summary = ERROR
2019-01-16 01:46:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181079  13 58499  6392293 A  ERRORERROR'
2019-01-16 01:46:32 [DEBUG   ] Got command RPT from MCS: ref #1181080
2019-01-16 01:46:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:46:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181080  77 58499  6392497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:46:32 [DEBUG   ] Got command RPT from MCS: ref #1181081
2019-01-16 01:46:32 [DEBUG   ] summary = ERROR
2019-01-16 01:46:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181081  13 58499  6392701 A  ERRORERROR'
2019-01-16 01:46:32 [DEBUG   ] Got command RPT from MCS: ref #1181083
2019-01-16 01:46:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:46:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181083  77 58499  6392905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:46:33 [DEBUG   ] Got command RPT from MCS: ref #1181085
2019-01-16 01:46:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 01:46:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181085  12 58499  6393097 A  ERRORB†ÌÍ'
2019-01-16 01:46:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:46:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-16 01:46:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:46:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:46:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:46:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:46:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:46:34 [DEBUG   ] Finished updating board flags in 1.969 seconds
2019-01-16 01:46:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 01:47:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 01:47:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 01:47:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 01:47:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:47:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 01:47:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:47:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:47:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:47:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:47:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:47:34 [DEBUG   ] Finished updating board flags in 1.800 seconds
2019-01-16 01:47:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 01:48:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 01:48:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 01:48:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 01:48:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:48:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:48:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:48:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:48:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:48:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:48:34 [DEBUG   ] Finished updating board flags in 1.609 seconds
2019-01-16 01:48:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 01:49:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 01:49:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 01:49:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:49:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:49:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:49:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:49:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:49:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:49:34 [DEBUG   ] Finished updating board flags in 1.633 seconds
2019-01-16 01:49:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 01:50:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 01:50:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 01:50:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:50:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:50:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:50:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:50:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:50:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:50:34 [DEBUG   ] Finished updating board flags in 1.657 seconds
2019-01-16 01:50:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 01:51:05 [DEBUG   ] Got command RPT from MCS: ref #1181097
2019-01-16 01:51:05 [DEBUG   ] summary = ERROR
2019-01-16 01:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181097  13 58499  6665169 A  ERRORERROR'
2019-01-16 01:51:05 [DEBUG   ] Got command RPT from MCS: ref #1181098
2019-01-16 01:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181098  77 58499  6665170 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:51:08 [DEBUG   ] Finished updating ant stats in 0.990 seconds
2019-01-16 01:51:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 01:51:32 [DEBUG   ] Got command RPT from MCS: ref #1181114
2019-01-16 01:51:32 [DEBUG   ] summary = ERROR
2019-01-16 01:51:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181114  13 58499  6692385 A  ERRORERROR'
2019-01-16 01:51:32 [DEBUG   ] Got command RPT from MCS: ref #1181115
2019-01-16 01:51:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:51:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181115  77 58499  6692589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:51:32 [DEBUG   ] Got command RPT from MCS: ref #1181116
2019-01-16 01:51:32 [DEBUG   ] summary = ERROR
2019-01-16 01:51:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181116  13 58499  6692781 A  ERRORERROR'
2019-01-16 01:51:32 [DEBUG   ] Got command RPT from MCS: ref #1181117
2019-01-16 01:51:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:51:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181117  77 58499  6692985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:51:33 [DEBUG   ] Got command RPT from MCS: ref #1181118
2019-01-16 01:51:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 01:51:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181118  12 58499  6693189 A  ERRORB™™š'
2019-01-16 01:51:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:51:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 01:51:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:51:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:51:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:51:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:51:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:51:34 [DEBUG   ] Finished updating board flags in 1.498 seconds
2019-01-16 01:51:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 01:52:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 01:52:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 01:52:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 01:52:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:52:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:52:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:52:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:52:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:52:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:52:34 [DEBUG   ] Finished updating board flags in 1.494 seconds
2019-01-16 01:52:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 01:53:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 01:53:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 01:53:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:53:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 01:53:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:53:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:53:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:53:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:53:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:53:34 [DEBUG   ] Finished updating board flags in 1.506 seconds
2019-01-16 01:53:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 01:54:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 01:54:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 01:54:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:54:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:54:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:54:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:54:34 [WARNING ] (13, 1, 'bot')
2019-01-16 01:54:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:54:34 [DEBUG   ] Finished updating board flags in 1.499 seconds
2019-01-16 01:54:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 01:55:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-16 01:55:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 01:55:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:55:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 01:55:35 [WARNING ] (13, 1, 'bot')
2019-01-16 01:55:35 [WARNING ] (13, 1, 'bot')
2019-01-16 01:55:35 [WARNING ] (13, 1, 'bot')
2019-01-16 01:55:35 [WARNING ] (13, 1, 'bot')
2019-01-16 01:55:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:55:35 [DEBUG   ] Finished updating board flags in 2.143 seconds
2019-01-16 01:55:48 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-16 01:56:05 [DEBUG   ] Got command RPT from MCS: ref #1181123
2019-01-16 01:56:05 [DEBUG   ] summary = ERROR
2019-01-16 01:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181123  13 58499  6965173 A  ERRORERROR'
2019-01-16 01:56:05 [DEBUG   ] Got command RPT from MCS: ref #1181124
2019-01-16 01:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181124  77 58499  6965174 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:56:08 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-16 01:56:29 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-16 01:56:32 [DEBUG   ] Got command RPT from MCS: ref #1181142
2019-01-16 01:56:32 [DEBUG   ] summary = ERROR
2019-01-16 01:56:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181142  13 58499  6992465 A  ERRORERROR'
2019-01-16 01:56:32 [DEBUG   ] Got command RPT from MCS: ref #1181143
2019-01-16 01:56:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:56:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181143  77 58499  6992669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:56:32 [DEBUG   ] Got command RPT from MCS: ref #1181144
2019-01-16 01:56:32 [DEBUG   ] summary = ERROR
2019-01-16 01:56:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181144  13 58499  6992873 A  ERRORERROR'
2019-01-16 01:56:33 [DEBUG   ] Got command RPT from MCS: ref #1181145
2019-01-16 01:56:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 01:56:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181145  77 58499  6993065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 01:56:33 [DEBUG   ] Got command RPT from MCS: ref #1181147
2019-01-16 01:56:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 01:56:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181147  12 58499  6993269 A  ERRORB˜™š'
2019-01-16 01:56:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:56:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 01:56:35 [WARNING ] (13, 1, 'bot')
2019-01-16 01:56:35 [WARNING ] (13, 1, 'bot')
2019-01-16 01:56:35 [WARNING ] (13, 1, 'bot')
2019-01-16 01:56:35 [WARNING ] (13, 1, 'bot')
2019-01-16 01:56:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:56:35 [DEBUG   ] Finished updating board flags in 1.963 seconds
2019-01-16 01:56:49 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-16 01:57:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 01:57:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 01:57:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:57:35 [WARNING ] (13, 1, 'bot')
2019-01-16 01:57:35 [WARNING ] (13, 1, 'bot')
2019-01-16 01:57:35 [WARNING ] (13, 1, 'bot')
2019-01-16 01:57:35 [WARNING ] (13, 1, 'bot')
2019-01-16 01:57:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:57:35 [DEBUG   ] Finished updating board flags in 1.830 seconds
2019-01-16 01:57:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 01:58:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 01:58:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 01:58:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:58:35 [WARNING ] (13, 1, 'bot')
2019-01-16 01:58:35 [WARNING ] (13, 1, 'bot')
2019-01-16 01:58:35 [WARNING ] (13, 1, 'bot')
2019-01-16 01:58:35 [WARNING ] (13, 1, 'bot')
2019-01-16 01:58:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:58:35 [DEBUG   ] Finished updating board flags in 1.878 seconds
2019-01-16 01:58:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 01:59:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 01:59:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 01:59:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 01:59:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 01:59:35 [WARNING ] (13, 1, 'bot')
2019-01-16 01:59:35 [WARNING ] (13, 1, 'bot')
2019-01-16 01:59:35 [WARNING ] (13, 1, 'bot')
2019-01-16 01:59:35 [WARNING ] (13, 1, 'bot')
2019-01-16 01:59:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 01:59:35 [DEBUG   ] Finished updating board flags in 1.713 seconds
2019-01-16 01:59:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 02:00:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 02:00:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 02:00:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:00:35 [WARNING ] (13, 1, 'bot')
2019-01-16 02:00:35 [WARNING ] (13, 1, 'bot')
2019-01-16 02:00:35 [WARNING ] (13, 1, 'bot')
2019-01-16 02:00:35 [WARNING ] (13, 1, 'bot')
2019-01-16 02:00:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:00:35 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-16 02:00:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-16 02:01:05 [DEBUG   ] Got command RPT from MCS: ref #1181160
2019-01-16 02:01:05 [DEBUG   ] summary = ERROR
2019-01-16 02:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181160  13 58499  7265165 A  ERRORERROR'
2019-01-16 02:01:05 [DEBUG   ] Got command RPT from MCS: ref #1181161
2019-01-16 02:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181161  77 58499  7265166 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:01:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 02:01:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 02:01:32 [DEBUG   ] Got command RPT from MCS: ref #1181177
2019-01-16 02:01:32 [DEBUG   ] summary = ERROR
2019-01-16 02:01:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181177  13 58499  7292549 A  ERRORERROR'
2019-01-16 02:01:32 [DEBUG   ] Got command RPT from MCS: ref #1181178
2019-01-16 02:01:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:01:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181178  77 58499  7292753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:01:32 [DEBUG   ] Got command RPT from MCS: ref #1181179
2019-01-16 02:01:32 [DEBUG   ] summary = ERROR
2019-01-16 02:01:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181179  13 58499  7292957 A  ERRORERROR'
2019-01-16 02:01:33 [DEBUG   ] Got command RPT from MCS: ref #1181180
2019-01-16 02:01:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:01:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181180  77 58499  7293149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:01:33 [DEBUG   ] Got command RPT from MCS: ref #1181181
2019-01-16 02:01:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 02:01:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181181  12 58499  7293353 A  ERRORB˜™š'
2019-01-16 02:01:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:01:35 [WARNING ] (13, 1, 'bot')
2019-01-16 02:01:35 [WARNING ] (13, 1, 'bot')
2019-01-16 02:01:35 [WARNING ] (13, 1, 'bot')
2019-01-16 02:01:35 [WARNING ] (13, 1, 'bot')
2019-01-16 02:01:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:01:35 [DEBUG   ] Finished updating board flags in 1.605 seconds
2019-01-16 02:01:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 02:02:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 02:02:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 02:02:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:02:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 02:02:35 [WARNING ] (13, 1, 'bot')
2019-01-16 02:02:35 [WARNING ] (13, 1, 'bot')
2019-01-16 02:02:35 [WARNING ] (13, 1, 'bot')
2019-01-16 02:02:35 [WARNING ] (13, 1, 'bot')
2019-01-16 02:02:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:02:35 [DEBUG   ] Finished updating board flags in 1.591 seconds
2019-01-16 02:02:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 02:03:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 02:03:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-16 02:03:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:03:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-16 02:03:35 [WARNING ] (13, 1, 'bot')
2019-01-16 02:03:35 [WARNING ] (13, 1, 'bot')
2019-01-16 02:03:35 [WARNING ] (13, 1, 'bot')
2019-01-16 02:03:35 [WARNING ] (13, 1, 'bot')
2019-01-16 02:03:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:03:35 [DEBUG   ] Finished updating board flags in 1.489 seconds
2019-01-16 02:03:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:04:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:04:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 02:04:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:04:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 02:04:35 [WARNING ] (13, 1, 'bot')
2019-01-16 02:04:35 [WARNING ] (13, 1, 'bot')
2019-01-16 02:04:35 [WARNING ] (13, 1, 'bot')
2019-01-16 02:04:35 [WARNING ] (13, 1, 'bot')
2019-01-16 02:04:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:04:35 [DEBUG   ] Finished updating board flags in 1.497 seconds
2019-01-16 02:04:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:05:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 02:05:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:05:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:05:35 [WARNING ] (13, 1, 'bot')
2019-01-16 02:05:35 [WARNING ] (13, 1, 'bot')
2019-01-16 02:05:35 [WARNING ] (13, 1, 'bot')
2019-01-16 02:05:35 [WARNING ] (13, 1, 'bot')
2019-01-16 02:05:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:05:35 [DEBUG   ] Finished updating board flags in 1.508 seconds
2019-01-16 02:05:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 02:06:05 [DEBUG   ] Got command RPT from MCS: ref #1181190
2019-01-16 02:06:05 [DEBUG   ] summary = ERROR
2019-01-16 02:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181190  13 58499  7565169 A  ERRORERROR'
2019-01-16 02:06:05 [DEBUG   ] Got command RPT from MCS: ref #1181191
2019-01-16 02:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181191  77 58499  7565170 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:06:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 02:06:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:06:32 [DEBUG   ] Got command RPT from MCS: ref #1181209
2019-01-16 02:06:32 [DEBUG   ] summary = ERROR
2019-01-16 02:06:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181209  13 58499  7592637 A  ERRORERROR'
2019-01-16 02:06:32 [DEBUG   ] Got command RPT from MCS: ref #1181210
2019-01-16 02:06:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:06:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181210  77 58499  7592841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:06:33 [DEBUG   ] Got command RPT from MCS: ref #1181211
2019-01-16 02:06:33 [DEBUG   ] summary = ERROR
2019-01-16 02:06:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181211  13 58499  7593033 A  ERRORERROR'
2019-01-16 02:06:33 [DEBUG   ] Got command RPT from MCS: ref #1181213
2019-01-16 02:06:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:06:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181213  77 58499  7593237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:06:33 [DEBUG   ] Got command RPT from MCS: ref #1181214
2019-01-16 02:06:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 02:06:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181214  12 58499  7593441 A  ERRORB™™š'
2019-01-16 02:06:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:06:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:06:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:06:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:06:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:06:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:06:36 [DEBUG   ] Finished updating board flags in 2.232 seconds
2019-01-16 02:06:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 02:07:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 02:07:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 02:07:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:07:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:07:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:07:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:07:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:07:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:07:36 [DEBUG   ] Finished updating board flags in 2.073 seconds
2019-01-16 02:07:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 02:08:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:08:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 02:08:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:08:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:08:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:08:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:08:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:08:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:08:36 [DEBUG   ] Finished updating board flags in 2.019 seconds
2019-01-16 02:08:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-16 02:09:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 02:09:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 02:09:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:09:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:09:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:09:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:09:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:09:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:09:36 [DEBUG   ] Finished updating board flags in 1.984 seconds
2019-01-16 02:09:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 02:10:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 02:10:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 02:10:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:10:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:10:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:10:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:10:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:10:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:10:36 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-01-16 02:10:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 02:11:05 [DEBUG   ] Got command RPT from MCS: ref #1181223
2019-01-16 02:11:05 [DEBUG   ] summary = ERROR
2019-01-16 02:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181223  13 58499  7865173 A  ERRORERROR'
2019-01-16 02:11:05 [DEBUG   ] Got command RPT from MCS: ref #1181224
2019-01-16 02:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181224  77 58499  7865174 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:11:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 02:11:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 02:11:32 [DEBUG   ] Got command RPT from MCS: ref #1181240
2019-01-16 02:11:32 [DEBUG   ] summary = ERROR
2019-01-16 02:11:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181240  13 58499  7892729 A  ERRORERROR'
2019-01-16 02:11:32 [DEBUG   ] Got command RPT from MCS: ref #1181241
2019-01-16 02:11:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:11:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181241  77 58499  7892921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:11:33 [DEBUG   ] Got command RPT from MCS: ref #1181242
2019-01-16 02:11:33 [DEBUG   ] summary = ERROR
2019-01-16 02:11:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181242  13 58499  7893125 A  ERRORERROR'
2019-01-16 02:11:33 [DEBUG   ] Got command RPT from MCS: ref #1181243
2019-01-16 02:11:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:11:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181243  77 58499  7893329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:11:33 [DEBUG   ] Got command RPT from MCS: ref #1181244
2019-01-16 02:11:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 02:11:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181244  12 58499  7893521 A  ERRORB™™š'
2019-01-16 02:11:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:11:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:11:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:11:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:11:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:11:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:11:36 [DEBUG   ] Finished updating board flags in 1.851 seconds
2019-01-16 02:11:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 02:12:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 02:12:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 02:12:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:12:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:12:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:12:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:12:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:12:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:12:36 [DEBUG   ] Finished updating board flags in 1.766 seconds
2019-01-16 02:12:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 02:13:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 02:13:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 02:13:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 02:13:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:13:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:13:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:13:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:13:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:13:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:13:36 [DEBUG   ] Finished updating board flags in 1.667 seconds
2019-01-16 02:13:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 02:14:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-16 02:14:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:14:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:14:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:14:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:14:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:14:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:14:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:14:36 [DEBUG   ] Finished updating board flags in 1.515 seconds
2019-01-16 02:14:50 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-01-16 02:15:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-16 02:15:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 02:15:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 02:15:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:15:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:15:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:15:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:15:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:15:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:15:36 [DEBUG   ] Finished updating board flags in 1.440 seconds
2019-01-16 02:15:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 02:16:05 [DEBUG   ] Got command RPT from MCS: ref #1181253
2019-01-16 02:16:05 [DEBUG   ] summary = ERROR
2019-01-16 02:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181253  13 58499  8165169 A  ERRORERROR'
2019-01-16 02:16:05 [DEBUG   ] Got command RPT from MCS: ref #1181254
2019-01-16 02:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181254  77 58499  8165170 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:16:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 02:16:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 02:16:32 [DEBUG   ] Got command RPT from MCS: ref #1181272
2019-01-16 02:16:32 [DEBUG   ] summary = ERROR
2019-01-16 02:16:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181272  13 58499  8192805 A  ERRORERROR'
2019-01-16 02:16:33 [DEBUG   ] Got command RPT from MCS: ref #1181273
2019-01-16 02:16:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:16:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181273  77 58499  8193009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:16:33 [DEBUG   ] Got command RPT from MCS: ref #1181274
2019-01-16 02:16:33 [DEBUG   ] summary = ERROR
2019-01-16 02:16:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181274  13 58499  8193213 A  ERRORERROR'
2019-01-16 02:16:33 [DEBUG   ] Got command RPT from MCS: ref #1181276
2019-01-16 02:16:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:16:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181276  77 58499  8193417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:16:33 [DEBUG   ] Got command RPT from MCS: ref #1181278
2019-01-16 02:16:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 02:16:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181278  12 58499  8193609 A  ERRORB˜™š'
2019-01-16 02:16:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:16:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:16:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:16:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:16:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:16:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:16:36 [DEBUG   ] Finished updating board flags in 1.458 seconds
2019-01-16 02:16:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 02:17:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 02:17:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 02:17:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:17:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:17:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:17:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:17:36 [WARNING ] (13, 1, 'bot')
2019-01-16 02:17:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:17:36 [DEBUG   ] Finished updating board flags in 1.487 seconds
2019-01-16 02:17:50 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-16 02:18:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 02:18:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 02:18:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:18:37 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 02:18:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 02:18:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:18:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:18:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:18:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:18:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:18:37 [DEBUG   ] Finished updating board flags in 2.244 seconds
2019-01-16 02:18:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-16 02:19:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:19:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:19:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-16 02:19:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:19:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:19:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:19:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:19:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:19:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:19:37 [DEBUG   ] Finished updating board flags in 2.181 seconds
2019-01-16 02:19:50 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-01-16 02:20:10 [DEBUG   ] Finished updating ant stats in 0.607 seconds
2019-01-16 02:20:30 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2019-01-16 02:20:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:20:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:20:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:20:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:20:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:20:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:20:37 [DEBUG   ] Finished updating board flags in 2.012 seconds
2019-01-16 02:20:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:21:05 [DEBUG   ] Got command RPT from MCS: ref #1181290
2019-01-16 02:21:05 [DEBUG   ] summary = ERROR
2019-01-16 02:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181290  13 58499  8465181 A  ERRORERROR'
2019-01-16 02:21:05 [DEBUG   ] Got command RPT from MCS: ref #1181291
2019-01-16 02:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181291  77 58499  8465182 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:21:11 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-16 02:21:31 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-16 02:21:32 [DEBUG   ] Got command RPT from MCS: ref #1181307
2019-01-16 02:21:32 [DEBUG   ] summary = ERROR
2019-01-16 02:21:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181307  13 58499  8492894 A  ERRORERROR'
2019-01-16 02:21:33 [DEBUG   ] Got command RPT from MCS: ref #1181308
2019-01-16 02:21:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:21:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181308  77 58499  8493097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:21:33 [DEBUG   ] Got command RPT from MCS: ref #1181309
2019-01-16 02:21:33 [DEBUG   ] summary = ERROR
2019-01-16 02:21:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181309  13 58499  8493301 A  ERRORERROR'
2019-01-16 02:21:33 [DEBUG   ] Got command RPT from MCS: ref #1181310
2019-01-16 02:21:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:21:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181310  77 58499  8493505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:21:33 [DEBUG   ] Got command RPT from MCS: ref #1181311
2019-01-16 02:21:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 02:21:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181311  12 58499  8493697 A  ERRORB™™š'
2019-01-16 02:21:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-16 02:21:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:21:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:21:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:21:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:21:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:21:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:21:37 [DEBUG   ] Finished updating board flags in 2.011 seconds
2019-01-16 02:21:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 02:22:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 02:22:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 02:22:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:22:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-16 02:22:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:22:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:22:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:22:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:22:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:22:37 [DEBUG   ] Finished updating board flags in 1.976 seconds
2019-01-16 02:22:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 02:23:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 02:23:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 02:23:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:23:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 02:23:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:23:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:23:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:23:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:23:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:23:37 [DEBUG   ] Finished updating board flags in 1.829 seconds
2019-01-16 02:23:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-16 02:24:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 02:24:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 02:24:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:24:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:24:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:24:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:24:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:24:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:24:37 [DEBUG   ] Finished updating board flags in 1.777 seconds
2019-01-16 02:24:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 02:25:11 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2019-01-16 02:25:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 02:25:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:25:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:25:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:25:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:25:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:25:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:25:37 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-16 02:25:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 02:26:05 [DEBUG   ] Got command RPT from MCS: ref #1181316
2019-01-16 02:26:05 [DEBUG   ] summary = ERROR
2019-01-16 02:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181316  13 58499  8765181 A  ERRORERROR'
2019-01-16 02:26:05 [DEBUG   ] Got command RPT from MCS: ref #1181317
2019-01-16 02:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181317  77 58499  8765182 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:26:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 02:26:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 02:26:32 [DEBUG   ] Got command RPT from MCS: ref #1181335
2019-01-16 02:26:32 [DEBUG   ] summary = ERROR
2019-01-16 02:26:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181335  13 58499  8792985 A  ERRORERROR'
2019-01-16 02:26:33 [DEBUG   ] Got command RPT from MCS: ref #1181336
2019-01-16 02:26:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:26:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181336  77 58499  8793189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:26:33 [DEBUG   ] Got command RPT from MCS: ref #1181337
2019-01-16 02:26:33 [DEBUG   ] summary = ERROR
2019-01-16 02:26:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181337  13 58499  8793381 A  ERRORERROR'
2019-01-16 02:26:33 [DEBUG   ] Got command RPT from MCS: ref #1181339
2019-01-16 02:26:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:26:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181339  77 58499  8793585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:26:33 [DEBUG   ] Got command RPT from MCS: ref #1181340
2019-01-16 02:26:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 02:26:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181340  12 58499  8793789 A  ERRORB™™š'
2019-01-16 02:26:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:26:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:26:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:26:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:26:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:26:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:26:37 [DEBUG   ] Finished updating board flags in 1.679 seconds
2019-01-16 02:26:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:27:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:27:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 02:27:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:27:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:27:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:27:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:27:37 [WARNING ] (13, 1, 'bot')
2019-01-16 02:27:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:27:37 [DEBUG   ] Finished updating board flags in 1.508 seconds
2019-01-16 02:27:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:28:00 [DEBUG   ] Got command RPT from MCS: ref #1181349
2019-01-16 02:28:00 [DEBUG   ] summary = ERROR
2019-01-16 02:28:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181349  13 58499  8880449 A  ERRORERROR'
2019-01-16 02:28:00 [DEBUG   ] Got command RPT from MCS: ref #1181350
2019-01-16 02:28:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:28:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181350  77 58499  8880450 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:28:05 [DEBUG   ] Got command INI from MCS: ref #1181351
2019-01-16 02:28:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2019-01-16 02:28:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI  1181351   8 58499  8885458 ABOOTING'
2019-01-16 02:28:29 [INFO    ] -------------------
2019-01-16 02:28:29 [INFO    ]  LWA board status
2019-01-16 02:28:29 [INFO    ] -------------------
2019-01-16 02:28:29 [INFO    ] DP 1: 2 lwa27
2019-01-16 02:28:29 [INFO    ] DP 1: 3 lwa24
2019-01-16 02:28:29 [INFO    ] DP 1: 4 lwa23
2019-01-16 02:28:29 [INFO    ] DP 1: 5 lwa18
2019-01-16 02:28:29 [INFO    ] DP 1: 6 lwa10
2019-01-16 02:28:29 [INFO    ] DP 1: 7 lwa32
2019-01-16 02:28:29 [INFO    ] DP 1: 8 lwa11
2019-01-16 02:28:29 [INFO    ] DP 1: 9 lwa30
2019-01-16 02:28:29 [INFO    ] DP 1: 10 lwa12
2019-01-16 02:28:29 [INFO    ] DP 1: 11 lwa8
2019-01-16 02:28:29 [INFO    ] DP 1: 12 lwa13
2019-01-16 02:28:29 [INFO    ] DP 1: 13 lwa26
2019-01-16 02:28:29 [INFO    ] DP 1: 14 lwa14
2019-01-16 02:28:29 [INFO    ] DP 1: 16 lwa22
2019-01-16 02:28:29 [INFO    ] DP 1: 17 lwa20
2019-01-16 02:28:29 [INFO    ] DP 1: 18 lwa1
2019-01-16 02:28:29 [INFO    ] DP 1: 19 lwa5
2019-01-16 02:28:29 [INFO    ] DP 1: 20 lwa25
2019-01-16 02:28:29 [INFO    ] DP 1: 21 lwa35
2019-01-16 02:28:29 [INFO    ] DP 1: 22 lwa19
2019-01-16 02:28:29 [INFO    ] DP 1: 23 lwa21
2019-01-16 02:28:29 [INFO    ] DP 1: 24 lwa6
2019-01-16 02:28:29 [INFO    ] DP 1: 25 lwa7
2019-01-16 02:28:29 [INFO    ] DP 1: 26 lwa33
2019-01-16 02:28:29 [INFO    ] DP 1: 27 lwa15
2019-01-16 02:28:29 [INFO    ] DP 1: 28 lwa28
2019-01-16 02:28:29 [INFO    ] DP 2: 1 lwa16
2019-01-16 02:28:29 [INFO    ] DP 2: 15 lwa34
2019-01-16 02:28:29 [INFO    ] Total of 28 boards
2019-01-16 02:28:29 [INFO    ] Total of 260 stands
2019-01-16 02:28:29 [INFO    ] -------------------
2019-01-16 02:28:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6505
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6506
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6507
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6508
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6509
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6510
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6511
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6512
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6513
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6514
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6515
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6516
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6517
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6518
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6519
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6520
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6521
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6522
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6523
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6524
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6525
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6526
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6527
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6528
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6529
2019-01-16 02:28:36 [DEBUG   ] 2019-01-16 02:28:36 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6530
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6505 exited with status 0
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6506 exited with status 0
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6507 exited with status 0
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6508 exited with status 0
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6509 exited with status 0
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6510 exited with status 0
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6511 exited with status 0
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6512 exited with status 0
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6513 exited with status 0
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6514 exited with status 0
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6515 exited with status 0
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6516 exited with status 0
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6517 exited with status 0
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6518 exited with status 0
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6519 exited with status 0
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6520 exited with status 0
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6521 exited with status 0
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6522 exited with status 0
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6523 exited with status 0
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6524 exited with status 0
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6525 exited with status 0
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6526 exited with status 0
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6527 exited with status 0
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6528 exited with status 0
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6529 exited with status 0
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6530 exited with status 0
2019-01-16 02:28:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] spawn_process: at 2019-01-16 02:28:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 6557
2019-01-16 02:28:49 [DEBUG   ] 2019-01-16 02:28:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 6558
2019-01-16 02:28:54 [DEBUG   ] 2019-01-16 02:28:54 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 6557 exited with status 0
2019-01-16 02:28:54 [DEBUG   ] 2019-01-16 02:28:54 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 6558 exited with status 0
2019-01-16 02:28:54 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2019-01-16 02:28:54 [DEBUG   ] spawn_process: at 2019-01-16 02:28:54 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2019-01-16 02:28:54 [DEBUG   ] spawn_process: at 2019-01-16 02:28:54 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2019-01-16 02:28:54 [INFO    ] Setting Beam 1 xbars
2019-01-16 02:28:54 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2019-01-16 02:28:54 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2019-01-16 02:28:54 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2019-01-16 02:28:55 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2019-01-16 02:28:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2019-01-16 02:28:55 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2019-01-16 02:28:55 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2019-01-16 02:28:55 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2019-01-16 02:28:55 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2019-01-16 02:28:55 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2019-01-16 02:28:55 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2019-01-16 02:28:55 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2019-01-16 02:28:56 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2019-01-16 02:28:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2019-01-16 02:28:56 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2019-01-16 02:28:56 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2019-01-16 02:28:56 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2019-01-16 02:28:56 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2019-01-16 02:28:56 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2019-01-16 02:28:56 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2019-01-16 02:28:56 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2019-01-16 02:28:56 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2019-01-16 02:28:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2019-01-16 02:28:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2019-01-16 02:28:57 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2019-01-16 02:28:57 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2019-01-16 02:28:57 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2019-01-16 02:28:57 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2019-01-16 02:28:57 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2019-01-16 02:28:57 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2019-01-16 02:28:57 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2019-01-16 02:28:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2019-01-16 02:28:58 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2019-01-16 02:28:58 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2019-01-16 02:28:58 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2019-01-16 02:28:58 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2019-01-16 02:28:58 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2019-01-16 02:28:58 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2019-01-16 02:28:58 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2019-01-16 02:28:58 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2019-01-16 02:28:59 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2019-01-16 02:28:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2019-01-16 02:28:59 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2019-01-16 02:28:59 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2019-01-16 02:28:59 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2019-01-16 02:28:59 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2019-01-16 02:28:59 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2019-01-16 02:28:59 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2019-01-16 02:28:59 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2019-01-16 02:29:00 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2019-01-16 02:29:00 [INFO    ] Setting Beam 2 xbars
2019-01-16 02:29:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2019-01-16 02:29:00 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2019-01-16 02:29:00 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2019-01-16 02:29:00 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2019-01-16 02:29:00 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2019-01-16 02:29:00 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2019-01-16 02:29:00 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2019-01-16 02:29:00 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2019-01-16 02:29:01 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2019-01-16 02:29:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2019-01-16 02:29:01 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2019-01-16 02:29:01 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2019-01-16 02:29:01 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2019-01-16 02:29:01 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2019-01-16 02:29:01 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2019-01-16 02:29:01 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2019-01-16 02:29:01 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2019-01-16 02:29:01 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2019-01-16 02:29:02 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2019-01-16 02:29:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2019-01-16 02:29:02 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2019-01-16 02:29:02 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2019-01-16 02:29:02 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2019-01-16 02:29:02 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2019-01-16 02:29:02 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2019-01-16 02:29:02 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2019-01-16 02:29:02 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2019-01-16 02:29:03 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2019-01-16 02:29:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2019-01-16 02:29:03 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2019-01-16 02:29:03 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2019-01-16 02:29:03 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2019-01-16 02:29:03 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2019-01-16 02:29:03 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2019-01-16 02:29:03 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2019-01-16 02:29:03 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2019-01-16 02:29:04 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2019-01-16 02:29:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2019-01-16 02:29:04 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2019-01-16 02:29:04 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2019-01-16 02:29:04 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2019-01-16 02:29:04 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2019-01-16 02:29:04 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2019-01-16 02:29:04 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2019-01-16 02:29:04 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2019-01-16 02:29:04 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2019-01-16 02:29:05 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2019-01-16 02:29:05 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2019-01-16 02:29:05 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2019-01-16 02:29:05 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2019-01-16 02:29:05 [INFO    ] Setting Beam 3 xbars
2019-01-16 02:29:05 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2019-01-16 02:29:05 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2019-01-16 02:29:05 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2019-01-16 02:29:05 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2019-01-16 02:29:05 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2019-01-16 02:29:06 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2019-01-16 02:29:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2019-01-16 02:29:06 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2019-01-16 02:29:06 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2019-01-16 02:29:06 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2019-01-16 02:29:06 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2019-01-16 02:29:06 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2019-01-16 02:29:06 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2019-01-16 02:29:06 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2019-01-16 02:29:07 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2019-01-16 02:29:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2019-01-16 02:29:07 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2019-01-16 02:29:07 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2019-01-16 02:29:07 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2019-01-16 02:29:07 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2019-01-16 02:29:07 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2019-01-16 02:29:07 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2019-01-16 02:29:07 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2019-01-16 02:29:08 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2019-01-16 02:29:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2019-01-16 02:29:08 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2019-01-16 02:29:08 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2019-01-16 02:29:08 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2019-01-16 02:29:08 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2019-01-16 02:29:08 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2019-01-16 02:29:08 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2019-01-16 02:29:08 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2019-01-16 02:29:08 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2019-01-16 02:29:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2019-01-16 02:29:09 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2019-01-16 02:29:09 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2019-01-16 02:29:09 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2019-01-16 02:29:09 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2019-01-16 02:29:09 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2019-01-16 02:29:09 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2019-01-16 02:29:09 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2019-01-16 02:29:09 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2019-01-16 02:29:10 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2019-01-16 02:29:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2019-01-16 02:29:10 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2019-01-16 02:29:10 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2019-01-16 02:29:10 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2019-01-16 02:29:10 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2019-01-16 02:29:10 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2019-01-16 02:29:10 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2019-01-16 02:29:10 [INFO    ] Setting Beam 4 xbars
2019-01-16 02:29:10 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2019-01-16 02:29:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-01-16 02:29:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-01-16 02:29:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-01-16 02:29:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-01-16 02:29:11 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2019-01-16 02:29:11 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2019-01-16 02:29:11 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2019-01-16 02:29:11 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2019-01-16 02:29:11 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2019-01-16 02:29:12 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2019-01-16 02:29:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2019-01-16 02:29:12 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2019-01-16 02:29:12 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2019-01-16 02:29:12 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2019-01-16 02:29:12 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2019-01-16 02:29:12 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2019-01-16 02:29:12 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2019-01-16 02:29:12 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2019-01-16 02:29:12 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2019-01-16 02:29:13 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2019-01-16 02:29:13 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2019-01-16 02:29:13 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2019-01-16 02:29:13 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2019-01-16 02:29:13 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2019-01-16 02:29:13 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2019-01-16 02:29:13 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2019-01-16 02:29:13 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2019-01-16 02:29:13 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2019-01-16 02:29:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2019-01-16 02:29:14 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2019-01-16 02:29:14 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2019-01-16 02:29:14 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2019-01-16 02:29:14 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2019-01-16 02:29:14 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2019-01-16 02:29:14 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2019-01-16 02:29:14 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2019-01-16 02:29:14 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2019-01-16 02:29:15 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2019-01-16 02:29:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2019-01-16 02:29:15 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2019-01-16 02:29:15 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2019-01-16 02:29:15 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2019-01-16 02:29:15 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2019-01-16 02:29:15 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2019-01-16 02:29:15 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2019-01-16 02:29:15 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2019-01-16 02:29:16 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2019-01-16 02:29:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2019-01-16 02:29:16 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2019-01-16 02:29:16 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2019-01-16 02:29:16 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2019-01-16 02:29:16 [INFO    ] All xbars set
2019-01-16 02:29:16 [INFO    ] Setting adder chain routing for all beams
2019-01-16 02:29:21 [INFO    ] Setting beam ids
2019-01-16 02:29:31 [INFO    ] Starting beam delay calibration
2019-01-16 02:29:43 [INFO    ] Beam 1 latency is 5721
2019-01-16 02:29:43 [INFO    ] Beam 2 latency is 5751
2019-01-16 02:29:43 [INFO    ] Beam 3 latency is 5752
2019-01-16 02:29:43 [INFO    ] Beam 4 latency is 5718
2019-01-16 02:29:43 [INFO    ] Stop calibration
2019-01-16 02:29:51 [INFO    ] Beam delay calibration successful
2019-01-16 02:29:51 [INFO    ] Calibration passed
2019-01-16 02:29:51 [DEBUG   ] spawn_process: at 2019-01-16 02:29:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2019-01-16 02:29:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2019-01-16 02:29:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2019-01-16 02:29:51 [DEBUG   ] spawn_process: at 2019-01-16 02:29:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2019-01-16 02:29:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2019-01-16 02:29:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2019-01-16 02:29:51 [DEBUG   ] spawn_process: at 2019-01-16 02:29:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2019-01-16 02:29:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2019-01-16 02:29:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2019-01-16 02:29:51 [DEBUG   ] spawn_process: at 2019-01-16 02:29:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2019-01-16 02:29:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2019-01-16 02:29:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2019-01-16 02:29:51 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2019-01-16 02:29:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 286 ms (1547605792.289 s) with PID 8135 and time 1547605793
2019-01-16 02:29:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2019-01-16 02:29:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 373 ms (1547605792.375 s) with PID 8138 and time 1547605793
2019-01-16 02:29:53 [DEBUG   ] Finished updating ant stats in 0.872 seconds
2019-01-16 02:29:53 [INFO    ] Started antennas statistics background thread
2019-01-16 02:29:53 [INFO    ] Started board flags background thread
2019-01-16 02:29:53 [INFO    ] Started BAM background thread
2019-01-16 02:29:53 [INFO    ] Finished the INI process (ref. #1181351) in 108.040 s
2019-01-16 02:29:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:29:54 [WARNING ] (13, 1, 'bot')
2019-01-16 02:29:54 [WARNING ] (13, 1, 'bot')
2019-01-16 02:29:54 [WARNING ] (13, 1, 'bot')
2019-01-16 02:29:54 [WARNING ] (13, 1, 'bot')
2019-01-16 02:29:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:29:54 [DEBUG   ] Finished updating board flags in 1.064 seconds
2019-01-16 02:30:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:30:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-16 02:30:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 02:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:30:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 02:30:54 [WARNING ] (13, 1, 'bot')
2019-01-16 02:30:54 [WARNING ] (13, 1, 'bot')
2019-01-16 02:30:54 [WARNING ] (13, 1, 'bot')
2019-01-16 02:30:54 [WARNING ] (13, 1, 'bot')
2019-01-16 02:30:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:30:54 [DEBUG   ] Finished updating board flags in 0.988 seconds
2019-01-16 02:31:05 [DEBUG   ] Got command RPT from MCS: ref #1181356
2019-01-16 02:31:05 [DEBUG   ] summary = ERROR
2019-01-16 02:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181356  13 58499  9065181 A  ERRORERROR'
2019-01-16 02:31:05 [DEBUG   ] Got command RPT from MCS: ref #1181357
2019-01-16 02:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181357  77 58499  9065182 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:31:05 [DEBUG   ] Got command RPT from MCS: ref #1181373
2019-01-16 02:31:05 [DEBUG   ] summary = ERROR
2019-01-16 02:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181373  13 58499  9065457 A  ERRORERROR'
2019-01-16 02:31:05 [DEBUG   ] Got command RPT from MCS: ref #1181374
2019-01-16 02:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181374  77 58499  9065458 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:31:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 02:31:33 [DEBUG   ] Got command RPT from MCS: ref #1181375
2019-01-16 02:31:33 [DEBUG   ] summary = ERROR
2019-01-16 02:31:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181375  13 58499  9093073 A  ERRORERROR'
2019-01-16 02:31:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 02:31:33 [DEBUG   ] Got command RPT from MCS: ref #1181376
2019-01-16 02:31:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:31:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181376  77 58499  9093269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:31:33 [DEBUG   ] Got command RPT from MCS: ref #1181377
2019-01-16 02:31:33 [DEBUG   ] summary = ERROR
2019-01-16 02:31:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181377  13 58499  9093473 A  ERRORERROR'
2019-01-16 02:31:33 [DEBUG   ] Got command RPT from MCS: ref #1181378
2019-01-16 02:31:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:31:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181378  77 58499  9093677 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:31:33 [DEBUG   ] Got command RPT from MCS: ref #1181379
2019-01-16 02:31:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 02:31:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181379  12 58499  9093881 A  ERRORB—™š'
2019-01-16 02:31:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 02:31:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:31:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-01-16 02:31:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:31:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:31:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:31:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:31:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:31:55 [DEBUG   ] Finished updating board flags in 1.834 seconds
2019-01-16 02:32:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 02:32:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 02:32:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 02:32:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:32:54 [WARNING ] (13, 1, 'bot')
2019-01-16 02:32:54 [WARNING ] (13, 1, 'bot')
2019-01-16 02:32:54 [WARNING ] (13, 1, 'bot')
2019-01-16 02:32:54 [WARNING ] (13, 1, 'bot')
2019-01-16 02:32:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:32:54 [DEBUG   ] Finished updating board flags in 1.212 seconds
2019-01-16 02:33:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 02:33:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 02:33:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 02:33:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:33:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:33:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:33:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:33:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:33:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:33:55 [DEBUG   ] Finished updating board flags in 1.778 seconds
2019-01-16 02:34:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 02:34:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 02:34:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 02:34:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:34:54 [WARNING ] (13, 1, 'bot')
2019-01-16 02:34:54 [WARNING ] (13, 1, 'bot')
2019-01-16 02:34:54 [WARNING ] (13, 1, 'bot')
2019-01-16 02:34:54 [WARNING ] (13, 1, 'bot')
2019-01-16 02:34:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:34:54 [DEBUG   ] Finished updating board flags in 1.041 seconds
2019-01-16 02:35:13 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-16 02:35:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:35:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:35:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:35:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 02:35:54 [WARNING ] (13, 1, 'bot')
2019-01-16 02:35:54 [WARNING ] (13, 1, 'bot')
2019-01-16 02:35:54 [WARNING ] (13, 1, 'bot')
2019-01-16 02:35:54 [WARNING ] (13, 1, 'bot')
2019-01-16 02:35:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:35:54 [DEBUG   ] Finished updating board flags in 1.033 seconds
2019-01-16 02:36:05 [DEBUG   ] Got command RPT from MCS: ref #1181388
2019-01-16 02:36:05 [DEBUG   ] summary = ERROR
2019-01-16 02:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181388  13 58499  9365181 A  ERRORERROR'
2019-01-16 02:36:05 [DEBUG   ] Got command RPT from MCS: ref #1181389
2019-01-16 02:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181389  77 58499  9365182 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:36:13 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-16 02:36:33 [DEBUG   ] Got command RPT from MCS: ref #1181407
2019-01-16 02:36:33 [DEBUG   ] summary = ERROR
2019-01-16 02:36:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181407  13 58499  9393153 A  ERRORERROR'
2019-01-16 02:36:33 [DEBUG   ] Got command RPT from MCS: ref #1181408
2019-01-16 02:36:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:36:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181408  77 58499  9393357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:36:33 [DEBUG   ] Got command RPT from MCS: ref #1181409
2019-01-16 02:36:33 [DEBUG   ] summary = ERROR
2019-01-16 02:36:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181409  13 58499  9393561 A  ERRORERROR'
2019-01-16 02:36:33 [DEBUG   ] Got command RPT from MCS: ref #1181411
2019-01-16 02:36:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:36:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181411  77 58499  9393765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:36:33 [DEBUG   ] Got command RPT from MCS: ref #1181412
2019-01-16 02:36:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 02:36:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181412  12 58499  9393957 A  ERRORB˜™š'
2019-01-16 02:36:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 02:36:54 [DEBUG   ] Finished updating ant stats in 1.232 seconds
2019-01-16 02:36:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:36:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:36:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:36:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:36:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:36:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:36:55 [DEBUG   ] Finished updating board flags in 1.574 seconds
2019-01-16 02:37:14 [DEBUG   ] Finished updating ant stats in 1.170 seconds
2019-01-16 02:37:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 02:37:54 [DEBUG   ] Finished updating ant stats in 1.032 seconds
2019-01-16 02:37:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:37:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:37:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:37:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:37:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:37:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:37:55 [DEBUG   ] Finished updating board flags in 1.359 seconds
2019-01-16 02:38:14 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2019-01-16 02:38:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:38:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:38:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 02:38:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:38:55 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 02:38:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:38:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:38:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:38:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:38:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:38:55 [DEBUG   ] Finished updating board flags in 1.222 seconds
2019-01-16 02:39:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:39:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:39:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:39:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:39:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:39:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:39:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:39:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:39:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:39:55 [DEBUG   ] Finished updating board flags in 1.189 seconds
2019-01-16 02:40:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:40:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:40:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:40:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:40:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 02:40:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:40:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:40:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:40:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:40:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:40:56 [DEBUG   ] Finished updating board flags in 2.034 seconds
2019-01-16 02:41:05 [DEBUG   ] Got command RPT from MCS: ref #1181421
2019-01-16 02:41:05 [DEBUG   ] summary = ERROR
2019-01-16 02:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181421  13 58499  9665177 A  ERRORERROR'
2019-01-16 02:41:05 [DEBUG   ] Got command RPT from MCS: ref #1181422
2019-01-16 02:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181422  77 58499  9665178 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:41:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:41:33 [DEBUG   ] Got command RPT from MCS: ref #1181438
2019-01-16 02:41:33 [DEBUG   ] summary = ERROR
2019-01-16 02:41:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181438  13 58499  9693245 A  ERRORERROR'
2019-01-16 02:41:33 [DEBUG   ] Got command RPT from MCS: ref #1181439
2019-01-16 02:41:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:41:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181439  77 58499  9693454 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:41:33 [DEBUG   ] Got command RPT from MCS: ref #1181440
2019-01-16 02:41:33 [DEBUG   ] summary = ERROR
2019-01-16 02:41:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181440  13 58499  9693641 A  ERRORERROR'
2019-01-16 02:41:33 [DEBUG   ] Got command RPT from MCS: ref #1181441
2019-01-16 02:41:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:41:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181441  77 58499  9693845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:41:34 [DEBUG   ] Got command RPT from MCS: ref #1181442
2019-01-16 02:41:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 02:41:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181442  12 58499  9694049 A  ERRORB˜™š'
2019-01-16 02:41:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:41:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:41:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 02:41:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:41:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:41:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:41:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:41:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:41:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:41:55 [DEBUG   ] Finished updating board flags in 1.379 seconds
2019-01-16 02:42:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:42:34 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-16 02:42:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 02:42:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:42:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:42:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:42:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:42:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:42:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:42:55 [DEBUG   ] Finished updating board flags in 1.235 seconds
2019-01-16 02:43:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 02:43:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 02:43:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 02:43:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:43:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:43:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:43:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:43:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:43:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:43:56 [DEBUG   ] Finished updating board flags in 1.758 seconds
2019-01-16 02:44:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 02:44:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 02:44:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 02:44:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 02:44:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:44:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:44:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:44:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:44:55 [WARNING ] (13, 1, 'bot')
2019-01-16 02:44:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:44:55 [DEBUG   ] Finished updating board flags in 1.027 seconds
2019-01-16 02:45:14 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2019-01-16 02:45:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 02:45:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:45:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 02:45:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:45:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:45:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:45:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:45:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:45:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:45:56 [DEBUG   ] Finished updating board flags in 1.572 seconds
2019-01-16 02:46:05 [DEBUG   ] Got command RPT from MCS: ref #1181451
2019-01-16 02:46:05 [DEBUG   ] summary = ERROR
2019-01-16 02:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181451  13 58499  9965177 A  ERRORERROR'
2019-01-16 02:46:05 [DEBUG   ] Got command RPT from MCS: ref #1181452
2019-01-16 02:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181452  77 58499  9965178 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:46:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:46:33 [DEBUG   ] Got command RPT from MCS: ref #1181470
2019-01-16 02:46:33 [DEBUG   ] summary = ERROR
2019-01-16 02:46:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181470  13 58499  9993333 A  ERRORERROR'
2019-01-16 02:46:33 [DEBUG   ] Got command RPT from MCS: ref #1181471
2019-01-16 02:46:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:46:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181471  77 58499  9993525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:46:33 [DEBUG   ] Got command RPT from MCS: ref #1181472
2019-01-16 02:46:33 [DEBUG   ] summary = ERROR
2019-01-16 02:46:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181472  13 58499  9993729 A  ERRORERROR'
2019-01-16 02:46:33 [DEBUG   ] Got command RPT from MCS: ref #1181474
2019-01-16 02:46:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:46:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181474  77 58499  9993946 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:46:34 [DEBUG   ] Got command RPT from MCS: ref #1181475
2019-01-16 02:46:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 02:46:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181475  12 58499  9994137 A  ERRORB˜™š'
2019-01-16 02:46:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:46:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:46:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:46:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:46:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:46:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:46:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:46:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:46:56 [DEBUG   ] Finished updating board flags in 1.390 seconds
2019-01-16 02:47:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:47:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:47:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:47:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:47:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:47:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:47:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:47:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:47:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:47:56 [DEBUG   ] Finished updating board flags in 1.251 seconds
2019-01-16 02:48:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:48:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:48:51 [DEBUG   ] Got command DRX from MCS: ref #1181488
2019-01-16 02:48:51 [INFO    ] sending drx command to lwa34
2019-01-16 02:48:51 [DEBUG   ] run_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 35100000.0 7 9 0']
2019-01-16 02:48:51 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-16 02:48:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1181488   8 58499 10131009 A  ERROR'
2019-01-16 02:48:51 [DEBUG   ] Got command DRX from MCS: ref #1181489
2019-01-16 02:48:51 [INFO    ] sending drx command to lwa16
2019-01-16 02:48:51 [DEBUG   ] run_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 64500000.0 7 9 0']
2019-01-16 02:48:51 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-16 02:48:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1181489   8 58499 10131013 A  ERROR'
2019-01-16 02:48:51 [DEBUG   ] Got command DRX from MCS: ref #1181490
2019-01-16 02:48:51 [INFO    ] sending drx command to lwa34
2019-01-16 02:48:51 [DEBUG   ] run_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 49800000.0 7 9 0']
2019-01-16 02:48:51 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-16 02:48:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1181490   8 58499 10131017 A  ERROR'
2019-01-16 02:48:51 [DEBUG   ] Got command DRX from MCS: ref #1181491
2019-01-16 02:48:51 [INFO    ] sending drx command to lwa16
2019-01-16 02:48:51 [DEBUG   ] run_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 79200000.0 7 9 0']
2019-01-16 02:48:51 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-16 02:48:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1181491   8 58499 10131021 A  ERROR'
2019-01-16 02:48:51 [DEBUG   ] Got command BAM from MCS: ref #1181492
2019-01-16 02:48:51 [INFO    ] Finished processing BAM request
2019-01-16 02:48:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:48:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181492   8 58499 10131025 A  ERROR'
2019-01-16 02:48:51 [DEBUG   ] Got command BAM from MCS: ref #1181493
2019-01-16 02:48:51 [INFO    ] Finished processing BAM request
2019-01-16 02:48:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:48:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181493   8 58499 10131029 A  ERROR'
2019-01-16 02:48:51 [INFO    ] Finished starting DRX
2019-01-16 02:48:51 [INFO    ] Finished starting DRX
2019-01-16 02:48:51 [INFO    ] Finished starting DRX
2019-01-16 02:48:51 [INFO    ] Finished starting DRX
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 02:48:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 02:48:51 [DEBUG   ] spawn_process: at 2019-01-16 02:48:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 02:48:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:48:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 02:48:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-16 02:48:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:48:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:48:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:48:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:48:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:48:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:48:56 [DEBUG   ] Finished updating board flags in 1.144 seconds
2019-01-16 02:49:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:49:21 [DEBUG   ] Got command BAM from MCS: ref #1181496
2019-01-16 02:49:21 [INFO    ] Finished processing BAM request
2019-01-16 02:49:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:49:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181496   8 58499 10161025 A  ERROR'
2019-01-16 02:49:21 [DEBUG   ] Got command BAM from MCS: ref #1181497
2019-01-16 02:49:21 [INFO    ] Finished processing BAM request
2019-01-16 02:49:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:49:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181497   8 58499 10161029 A  ERROR'
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 02:49:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 02:49:21 [DEBUG   ] spawn_process: at 2019-01-16 02:49:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 02:49:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:49:51 [DEBUG   ] Got command BAM from MCS: ref #1181499
2019-01-16 02:49:51 [INFO    ] Finished processing BAM request
2019-01-16 02:49:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:49:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181499   8 58499 10191033 A  ERROR'
2019-01-16 02:49:51 [DEBUG   ] Got command BAM from MCS: ref #1181498
2019-01-16 02:49:51 [INFO    ] Finished processing BAM request
2019-01-16 02:49:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:49:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181498   8 58499 10191037 A  ERROR'
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 02:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 02:49:51 [DEBUG   ] spawn_process: at 2019-01-16 02:49:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 02:49:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:49:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-01-16 02:49:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:49:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:49:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:49:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:49:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:49:56 [DEBUG   ] Finished updating board flags in 1.009 seconds
2019-01-16 02:50:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:50:21 [DEBUG   ] Got command BAM from MCS: ref #1181500
2019-01-16 02:50:21 [INFO    ] Finished processing BAM request
2019-01-16 02:50:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:50:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181500   8 58499 10221025 A  ERROR'
2019-01-16 02:50:21 [DEBUG   ] Got command BAM from MCS: ref #1181501
2019-01-16 02:50:21 [INFO    ] Finished processing BAM request
2019-01-16 02:50:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:50:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181501   8 58499 10221029 A  ERROR'
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 02:50:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 02:50:21 [DEBUG   ] spawn_process: at 2019-01-16 02:50:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 02:50:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:50:51 [DEBUG   ] Got command BAM from MCS: ref #1181507
2019-01-16 02:50:51 [INFO    ] Finished processing BAM request
2019-01-16 02:50:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:50:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181507   8 58499 10251033 A  ERROR'
2019-01-16 02:50:51 [DEBUG   ] Got command BAM from MCS: ref #1181506
2019-01-16 02:50:51 [INFO    ] Finished processing BAM request
2019-01-16 02:50:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:50:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181506   8 58499 10251037 A  ERROR'
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 02:50:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 02:50:51 [DEBUG   ] spawn_process: at 2019-01-16 02:50:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 02:50:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:50:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 02:50:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:50:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:50:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:50:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:50:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:50:56 [DEBUG   ] Finished updating board flags in 1.007 seconds
2019-01-16 02:51:05 [DEBUG   ] Got command RPT from MCS: ref #1181508
2019-01-16 02:51:05 [DEBUG   ] summary = ERROR
2019-01-16 02:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181508  13 58499 10265189 A  ERRORERROR'
2019-01-16 02:51:05 [DEBUG   ] Got command RPT from MCS: ref #1181509
2019-01-16 02:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181509  77 58499 10265190 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:51:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:51:21 [DEBUG   ] Got command BAM from MCS: ref #1181526
2019-01-16 02:51:21 [INFO    ] Finished processing BAM request
2019-01-16 02:51:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:51:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181526   8 58499 10281025 A  ERROR'
2019-01-16 02:51:21 [DEBUG   ] Got command BAM from MCS: ref #1181525
2019-01-16 02:51:21 [INFO    ] Finished processing BAM request
2019-01-16 02:51:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:51:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181525   8 58499 10281029 A  ERROR'
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 02:51:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 02:51:21 [DEBUG   ] spawn_process: at 2019-01-16 02:51:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 02:51:33 [DEBUG   ] Got command RPT from MCS: ref #1181527
2019-01-16 02:51:33 [DEBUG   ] summary = ERROR
2019-01-16 02:51:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181527  13 58499 10293413 A  ERRORERROR'
2019-01-16 02:51:33 [DEBUG   ] Got command RPT from MCS: ref #1181528
2019-01-16 02:51:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:51:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181528  77 58499 10293617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:51:33 [DEBUG   ] Got command RPT from MCS: ref #1181529
2019-01-16 02:51:33 [DEBUG   ] summary = ERROR
2019-01-16 02:51:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181529  13 58499 10293821 A  ERRORERROR'
2019-01-16 02:51:34 [DEBUG   ] Got command RPT from MCS: ref #1181530
2019-01-16 02:51:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:51:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181530  77 58499 10294021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:51:34 [DEBUG   ] Got command RPT from MCS: ref #1181531
2019-01-16 02:51:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 02:51:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181531  12 58499 10294217 A  ERRORBŸff'
2019-01-16 02:51:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:51:51 [DEBUG   ] Got command BAM from MCS: ref #1181533
2019-01-16 02:51:51 [INFO    ] Finished processing BAM request
2019-01-16 02:51:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:51:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181533   8 58499 10311033 A  ERROR'
2019-01-16 02:51:51 [DEBUG   ] Got command BAM from MCS: ref #1181532
2019-01-16 02:51:51 [INFO    ] Finished processing BAM request
2019-01-16 02:51:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:51:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181532   8 58499 10311037 A  ERROR'
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 02:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 02:51:51 [DEBUG   ] spawn_process: at 2019-01-16 02:51:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 02:51:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:51:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-16 02:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:51:56 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-16 02:51:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:51:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:51:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:51:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:51:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:51:56 [DEBUG   ] Finished updating board flags in 1.011 seconds
2019-01-16 02:52:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:52:21 [DEBUG   ] Got command BAM from MCS: ref #1181535
2019-01-16 02:52:21 [INFO    ] Finished processing BAM request
2019-01-16 02:52:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:52:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181535   8 58499 10341025 A  ERROR'
2019-01-16 02:52:21 [DEBUG   ] Got command BAM from MCS: ref #1181534
2019-01-16 02:52:21 [INFO    ] Finished processing BAM request
2019-01-16 02:52:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:52:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181534   8 58499 10341029 A  ERROR'
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 02:52:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 02:52:21 [DEBUG   ] spawn_process: at 2019-01-16 02:52:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 02:52:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:52:51 [DEBUG   ] Got command BAM from MCS: ref #1181536
2019-01-16 02:52:51 [INFO    ] Finished processing BAM request
2019-01-16 02:52:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:52:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181536   8 58499 10371025 A  ERROR'
2019-01-16 02:52:51 [DEBUG   ] Got command BAM from MCS: ref #1181537
2019-01-16 02:52:51 [INFO    ] Finished processing BAM request
2019-01-16 02:52:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:52:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181537   8 58499 10371029 A  ERROR'
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 02:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 02:52:51 [DEBUG   ] spawn_process: at 2019-01-16 02:52:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 02:52:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 02:52:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 02:52:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 02:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:52:56 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 02:52:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 02:52:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 02:52:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:52:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:52:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:52:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:52:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:52:56 [DEBUG   ] Finished updating board flags in 0.989 seconds
2019-01-16 02:53:14 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-16 02:53:21 [DEBUG   ] Got command BAM from MCS: ref #1181539
2019-01-16 02:53:21 [INFO    ] Finished processing BAM request
2019-01-16 02:53:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181539   8 58499 10401025 A  ERROR'
2019-01-16 02:53:21 [DEBUG   ] Got command BAM from MCS: ref #1181538
2019-01-16 02:53:21 [INFO    ] Finished processing BAM request
2019-01-16 02:53:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181538   8 58499 10401029 A  ERROR'
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 02:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 02:53:21 [DEBUG   ] spawn_process: at 2019-01-16 02:53:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 02:53:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 02:53:51 [DEBUG   ] Got command BAM from MCS: ref #1181544
2019-01-16 02:53:51 [INFO    ] Finished processing BAM request
2019-01-16 02:53:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:53:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181544   8 58499 10431025 A  ERROR'
2019-01-16 02:53:51 [DEBUG   ] Got command BAM from MCS: ref #1181545
2019-01-16 02:53:51 [INFO    ] Finished processing BAM request
2019-01-16 02:53:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:53:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181545   8 58499 10431029 A  ERROR'
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 02:53:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 02:53:51 [DEBUG   ] spawn_process: at 2019-01-16 02:53:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 02:53:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 02:53:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:53:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 02:53:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 02:53:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 02:53:57 [WARNING ] (13, 1, 'bot')
2019-01-16 02:53:57 [WARNING ] (13, 1, 'bot')
2019-01-16 02:53:57 [WARNING ] (13, 1, 'bot')
2019-01-16 02:53:57 [WARNING ] (13, 1, 'bot')
2019-01-16 02:53:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:53:57 [DEBUG   ] Finished updating board flags in 1.805 seconds
2019-01-16 02:54:15 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-16 02:54:21 [DEBUG   ] Got command BAM from MCS: ref #1181546
2019-01-16 02:54:21 [INFO    ] Finished processing BAM request
2019-01-16 02:54:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:54:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181546   8 58499 10461025 A  ERROR'
2019-01-16 02:54:21 [DEBUG   ] Got command BAM from MCS: ref #1181547
2019-01-16 02:54:21 [INFO    ] Finished processing BAM request
2019-01-16 02:54:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:54:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181547   8 58499 10461029 A  ERROR'
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 02:54:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 02:54:21 [DEBUG   ] spawn_process: at 2019-01-16 02:54:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 02:54:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 02:54:51 [DEBUG   ] Got command BAM from MCS: ref #1181549
2019-01-16 02:54:51 [INFO    ] Finished processing BAM request
2019-01-16 02:54:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:54:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181549   8 58499 10491033 A  ERROR'
2019-01-16 02:54:51 [DEBUG   ] Got command BAM from MCS: ref #1181548
2019-01-16 02:54:51 [INFO    ] Finished processing BAM request
2019-01-16 02:54:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:54:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181548   8 58499 10491037 A  ERROR'
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 02:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 02:54:51 [DEBUG   ] spawn_process: at 2019-01-16 02:54:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 02:54:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 02:54:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-16 02:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:54:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 02:54:56 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 02:54:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:54:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:54:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:54:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:54:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:54:56 [DEBUG   ] Finished updating board flags in 1.250 seconds
2019-01-16 02:55:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 02:55:21 [DEBUG   ] Got command BAM from MCS: ref #1181550
2019-01-16 02:55:21 [INFO    ] Finished processing BAM request
2019-01-16 02:55:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:55:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181550   8 58499 10521029 A  ERROR'
2019-01-16 02:55:21 [DEBUG   ] Got command BAM from MCS: ref #1181551
2019-01-16 02:55:21 [INFO    ] Finished processing BAM request
2019-01-16 02:55:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:55:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181551   8 58499 10521033 A  ERROR'
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 02:55:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 02:55:21 [DEBUG   ] spawn_process: at 2019-01-16 02:55:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 02:55:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 02:55:51 [DEBUG   ] Got command BAM from MCS: ref #1181553
2019-01-16 02:55:51 [INFO    ] Finished processing BAM request
2019-01-16 02:55:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:55:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181553   8 58499 10551025 A  ERROR'
2019-01-16 02:55:51 [DEBUG   ] Got command BAM from MCS: ref #1181552
2019-01-16 02:55:51 [INFO    ] Finished processing BAM request
2019-01-16 02:55:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:55:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181552   8 58499 10551029 A  ERROR'
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 02:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 02:55:51 [DEBUG   ] spawn_process: at 2019-01-16 02:55:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 02:55:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 02:55:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 02:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:55:56 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 02:55:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:55:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:55:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:55:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:55:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:55:56 [DEBUG   ] Finished updating board flags in 1.233 seconds
2019-01-16 02:56:05 [DEBUG   ] Got command RPT from MCS: ref #1181554
2019-01-16 02:56:05 [DEBUG   ] summary = ERROR
2019-01-16 02:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181554  13 58499 10565185 A  ERRORERROR'
2019-01-16 02:56:05 [DEBUG   ] Got command RPT from MCS: ref #1181555
2019-01-16 02:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181555  77 58499 10565186 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:56:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 02:56:21 [DEBUG   ] Got command BAM from MCS: ref #1181572
2019-01-16 02:56:21 [INFO    ] Finished processing BAM request
2019-01-16 02:56:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:56:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181572   8 58499 10581029 A  ERROR'
2019-01-16 02:56:21 [DEBUG   ] Got command BAM from MCS: ref #1181571
2019-01-16 02:56:21 [INFO    ] Finished processing BAM request
2019-01-16 02:56:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:56:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181571   8 58499 10581033 A  ERROR'
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 02:56:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 02:56:21 [DEBUG   ] spawn_process: at 2019-01-16 02:56:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 02:56:33 [DEBUG   ] Got command RPT from MCS: ref #1181575
2019-01-16 02:56:33 [DEBUG   ] summary = ERROR
2019-01-16 02:56:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181575  13 58499 10593501 A  ERRORERROR'
2019-01-16 02:56:33 [DEBUG   ] Got command RPT from MCS: ref #1181576
2019-01-16 02:56:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:56:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181576  77 58499 10593705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:56:33 [DEBUG   ] Got command RPT from MCS: ref #1181577
2019-01-16 02:56:33 [DEBUG   ] summary = ERROR
2019-01-16 02:56:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181577  13 58499 10593909 A  ERRORERROR'
2019-01-16 02:56:34 [DEBUG   ] Got command RPT from MCS: ref #1181579
2019-01-16 02:56:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 02:56:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181579  77 58499 10594101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 02:56:34 [DEBUG   ] Got command RPT from MCS: ref #1181580
2019-01-16 02:56:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 02:56:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181580  12 58499 10594306 A  ERRORB£ff'
2019-01-16 02:56:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 02:56:51 [DEBUG   ] Got command BAM from MCS: ref #1181589
2019-01-16 02:56:51 [INFO    ] Finished processing BAM request
2019-01-16 02:56:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:56:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181589   8 58499 10611025 A  ERROR'
2019-01-16 02:56:51 [DEBUG   ] Got command BAM from MCS: ref #1181590
2019-01-16 02:56:51 [INFO    ] Finished processing BAM request
2019-01-16 02:56:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:56:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181590   8 58499 10611029 A  ERROR'
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 02:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 02:56:51 [DEBUG   ] spawn_process: at 2019-01-16 02:56:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 02:56:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 02:56:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 02:56:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 02:56:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:56:56 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 02:56:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:56:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:56:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:56:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:56:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:56:56 [DEBUG   ] Finished updating board flags in 1.227 seconds
2019-01-16 02:57:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 02:57:21 [DEBUG   ] Got command BAM from MCS: ref #1181592
2019-01-16 02:57:21 [INFO    ] Finished processing BAM request
2019-01-16 02:57:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:57:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181592   8 58499 10641101 A  ERROR'
2019-01-16 02:57:21 [DEBUG   ] Got command BAM from MCS: ref #1181591
2019-01-16 02:57:21 [INFO    ] Finished processing BAM request
2019-01-16 02:57:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:57:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181591   8 58499 10641105 A  ERROR'
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 02:57:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 02:57:21 [DEBUG   ] spawn_process: at 2019-01-16 02:57:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 02:57:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 02:57:51 [DEBUG   ] Got command BAM from MCS: ref #1181594
2019-01-16 02:57:51 [INFO    ] Finished processing BAM request
2019-01-16 02:57:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:57:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181594   8 58499 10671025 A  ERROR'
2019-01-16 02:57:51 [DEBUG   ] Got command BAM from MCS: ref #1181593
2019-01-16 02:57:51 [INFO    ] Finished processing BAM request
2019-01-16 02:57:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:57:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181593   8 58499 10671029 A  ERROR'
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 02:57:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 02:57:51 [DEBUG   ] spawn_process: at 2019-01-16 02:57:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 02:57:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 02:57:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 02:57:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:57:56 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 02:57:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:57:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:57:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:57:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:57:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:57:56 [DEBUG   ] Finished updating board flags in 1.151 seconds
2019-01-16 02:58:15 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-16 02:58:21 [DEBUG   ] Got command BAM from MCS: ref #1181596
2019-01-16 02:58:21 [INFO    ] Finished processing BAM request
2019-01-16 02:58:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181596   8 58499 10701029 A  ERROR'
2019-01-16 02:58:21 [DEBUG   ] Got command BAM from MCS: ref #1181595
2019-01-16 02:58:21 [INFO    ] Finished processing BAM request
2019-01-16 02:58:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181595   8 58499 10701033 A  ERROR'
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 02:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 02:58:21 [DEBUG   ] spawn_process: at 2019-01-16 02:58:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 02:58:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:58:51 [DEBUG   ] Got command BAM from MCS: ref #1181598
2019-01-16 02:58:51 [INFO    ] Finished processing BAM request
2019-01-16 02:58:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:58:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181598   8 58499 10731033 A  ERROR'
2019-01-16 02:58:51 [DEBUG   ] Got command BAM from MCS: ref #1181597
2019-01-16 02:58:51 [INFO    ] Finished processing BAM request
2019-01-16 02:58:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:58:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181597   8 58499 10731037 A  ERROR'
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 02:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 02:58:51 [DEBUG   ] spawn_process: at 2019-01-16 02:58:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 02:58:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:58:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:58:56 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 02:58:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:58:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:58:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:58:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:58:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:58:56 [DEBUG   ] Finished updating board flags in 1.014 seconds
2019-01-16 02:59:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:59:21 [DEBUG   ] Got command BAM from MCS: ref #1181600
2019-01-16 02:59:21 [INFO    ] Finished processing BAM request
2019-01-16 02:59:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:59:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181600   8 58499 10761025 A  ERROR'
2019-01-16 02:59:21 [DEBUG   ] Got command BAM from MCS: ref #1181599
2019-01-16 02:59:21 [INFO    ] Finished processing BAM request
2019-01-16 02:59:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:59:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181599   8 58499 10761029 A  ERROR'
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 02:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 02:59:21 [DEBUG   ] spawn_process: at 2019-01-16 02:59:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 02:59:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:59:51 [DEBUG   ] Got command BAM from MCS: ref #1181605
2019-01-16 02:59:51 [INFO    ] Finished processing BAM request
2019-01-16 02:59:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:59:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181605   8 58499 10791033 A  ERROR'
2019-01-16 02:59:51 [DEBUG   ] Got command BAM from MCS: ref #1181606
2019-01-16 02:59:51 [INFO    ] Finished processing BAM request
2019-01-16 02:59:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 02:59:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181606   8 58499 10791037 A  ERROR'
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 02:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 02:59:51 [DEBUG   ] spawn_process: at 2019-01-16 02:59:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 02:59:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 02:59:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 02:59:56 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 02:59:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 02:59:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:59:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:59:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:59:56 [WARNING ] (13, 1, 'bot')
2019-01-16 02:59:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 02:59:56 [DEBUG   ] Finished updating board flags in 1.013 seconds
2019-01-16 03:00:15 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-16 03:00:21 [DEBUG   ] Got command BAM from MCS: ref #1181607
2019-01-16 03:00:21 [INFO    ] Finished processing BAM request
2019-01-16 03:00:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:00:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181607   8 58499 10821029 A  ERROR'
2019-01-16 03:00:21 [DEBUG   ] Got command BAM from MCS: ref #1181608
2019-01-16 03:00:21 [INFO    ] Finished processing BAM request
2019-01-16 03:00:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:00:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181608   8 58499 10821033 A  ERROR'
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 03:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 03:00:21 [DEBUG   ] spawn_process: at 2019-01-16 03:00:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 03:00:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:00:51 [DEBUG   ] Got command BAM from MCS: ref #1181609
2019-01-16 03:00:51 [INFO    ] Finished processing BAM request
2019-01-16 03:00:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:00:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181609   8 58499 10851025 A  ERROR'
2019-01-16 03:00:51 [DEBUG   ] Got command BAM from MCS: ref #1181610
2019-01-16 03:00:51 [INFO    ] Finished processing BAM request
2019-01-16 03:00:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:00:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181610   8 58499 10851029 A  ERROR'
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 03:00:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 03:00:51 [DEBUG   ] spawn_process: at 2019-01-16 03:00:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 03:00:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:00:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:00:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-16 03:00:56 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:00:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 03:00:56 [WARNING ] (13, 1, 'bot')
2019-01-16 03:00:56 [WARNING ] (13, 1, 'bot')
2019-01-16 03:00:56 [WARNING ] (13, 1, 'bot')
2019-01-16 03:00:56 [WARNING ] (13, 1, 'bot')
2019-01-16 03:00:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:00:56 [DEBUG   ] Finished updating board flags in 0.960 seconds
2019-01-16 03:01:05 [DEBUG   ] Got command RPT from MCS: ref #1181611
2019-01-16 03:01:05 [DEBUG   ] summary = ERROR
2019-01-16 03:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181611  13 58499 10865185 A  ERRORERROR'
2019-01-16 03:01:05 [DEBUG   ] Got command RPT from MCS: ref #1181612
2019-01-16 03:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181612  77 58499 10865186 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:01:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 03:01:21 [DEBUG   ] Got command BAM from MCS: ref #1181629
2019-01-16 03:01:21 [INFO    ] Finished processing BAM request
2019-01-16 03:01:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:01:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181629   8 58499 10881029 A  ERROR'
2019-01-16 03:01:21 [DEBUG   ] Got command BAM from MCS: ref #1181628
2019-01-16 03:01:21 [INFO    ] Finished processing BAM request
2019-01-16 03:01:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:01:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181628   8 58499 10881033 A  ERROR'
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 03:01:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 03:01:21 [DEBUG   ] spawn_process: at 2019-01-16 03:01:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 03:01:33 [DEBUG   ] Got command RPT from MCS: ref #1181630
2019-01-16 03:01:33 [DEBUG   ] summary = ERROR
2019-01-16 03:01:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181630  13 58499 10893597 A  ERRORERROR'
2019-01-16 03:01:33 [DEBUG   ] Got command RPT from MCS: ref #1181631
2019-01-16 03:01:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:01:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181631  77 58499 10893789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:01:33 [DEBUG   ] Got command RPT from MCS: ref #1181632
2019-01-16 03:01:33 [DEBUG   ] summary = ERROR
2019-01-16 03:01:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181632  13 58499 10893993 A  ERRORERROR'
2019-01-16 03:01:34 [DEBUG   ] Got command RPT from MCS: ref #1181633
2019-01-16 03:01:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:01:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181633  77 58499 10894197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:01:34 [DEBUG   ] Got command RPT from MCS: ref #1181634
2019-01-16 03:01:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 03:01:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181634  12 58499 10894389 A  ERRORB¢ff'
2019-01-16 03:01:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:01:51 [DEBUG   ] Got command BAM from MCS: ref #1181635
2019-01-16 03:01:51 [INFO    ] Finished processing BAM request
2019-01-16 03:01:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:01:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181635   8 58499 10911021 A  ERROR'
2019-01-16 03:01:51 [DEBUG   ] Got command BAM from MCS: ref #1181636
2019-01-16 03:01:51 [INFO    ] Finished processing BAM request
2019-01-16 03:01:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:01:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181636   8 58499 10911025 A  ERROR'
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 03:01:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 03:01:51 [DEBUG   ] spawn_process: at 2019-01-16 03:01:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 03:01:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:01:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:01:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:01:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:01:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:01:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:01:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:01:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:01:57 [DEBUG   ] Finished updating board flags in 1.378 seconds
2019-01-16 03:02:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:02:21 [DEBUG   ] Got command BAM from MCS: ref #1181638
2019-01-16 03:02:21 [INFO    ] Finished processing BAM request
2019-01-16 03:02:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:02:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181638   8 58499 10941033 A  ERROR'
2019-01-16 03:02:21 [DEBUG   ] Got command BAM from MCS: ref #1181637
2019-01-16 03:02:21 [INFO    ] Finished processing BAM request
2019-01-16 03:02:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:02:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181637   8 58499 10941037 A  ERROR'
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 03:02:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 03:02:21 [DEBUG   ] spawn_process: at 2019-01-16 03:02:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 03:02:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:02:51 [DEBUG   ] Got command BAM from MCS: ref #1181643
2019-01-16 03:02:51 [INFO    ] Finished processing BAM request
2019-01-16 03:02:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:02:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181643   8 58499 10971025 A  ERROR'
2019-01-16 03:02:51 [DEBUG   ] Got command BAM from MCS: ref #1181644
2019-01-16 03:02:51 [INFO    ] Finished processing BAM request
2019-01-16 03:02:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:02:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181644   8 58499 10971029 A  ERROR'
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 03:02:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 03:02:51 [DEBUG   ] spawn_process: at 2019-01-16 03:02:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 03:02:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:02:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 03:02:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:02:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:02:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:02:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:02:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:02:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:02:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:02:57 [DEBUG   ] Finished updating board flags in 1.188 seconds
2019-01-16 03:03:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:03:21 [DEBUG   ] Got command BAM from MCS: ref #1181646
2019-01-16 03:03:21 [INFO    ] Finished processing BAM request
2019-01-16 03:03:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181646   8 58499 11001029 A  ERROR'
2019-01-16 03:03:21 [DEBUG   ] Got command BAM from MCS: ref #1181645
2019-01-16 03:03:21 [INFO    ] Finished processing BAM request
2019-01-16 03:03:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181645   8 58499 11001033 A  ERROR'
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 03:03:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 03:03:21 [DEBUG   ] spawn_process: at 2019-01-16 03:03:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 03:03:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 03:03:51 [DEBUG   ] Got command BAM from MCS: ref #1181647
2019-01-16 03:03:51 [INFO    ] Finished processing BAM request
2019-01-16 03:03:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:03:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181647   8 58499 11031025 A  ERROR'
2019-01-16 03:03:51 [DEBUG   ] Got command BAM from MCS: ref #1181648
2019-01-16 03:03:51 [INFO    ] Finished processing BAM request
2019-01-16 03:03:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:03:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181648   8 58499 11031029 A  ERROR'
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 03:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 03:03:51 [DEBUG   ] spawn_process: at 2019-01-16 03:03:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 03:03:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:03:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:03:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2019-01-16 03:03:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:03:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:03:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:03:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:03:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:03:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:03:57 [DEBUG   ] Finished updating board flags in 1.008 seconds
2019-01-16 03:04:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 03:04:21 [DEBUG   ] Got command BAM from MCS: ref #1181649
2019-01-16 03:04:21 [INFO    ] Finished processing BAM request
2019-01-16 03:04:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:04:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181649   8 58499 11061025 A  ERROR'
2019-01-16 03:04:21 [DEBUG   ] Got command BAM from MCS: ref #1181650
2019-01-16 03:04:21 [INFO    ] Finished processing BAM request
2019-01-16 03:04:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:04:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181650   8 58499 11061029 A  ERROR'
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 03:04:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 03:04:21 [DEBUG   ] spawn_process: at 2019-01-16 03:04:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 03:04:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:04:51 [DEBUG   ] Got command BAM from MCS: ref #1181651
2019-01-16 03:04:51 [INFO    ] Finished processing BAM request
2019-01-16 03:04:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:04:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181651   8 58499 11091033 A  ERROR'
2019-01-16 03:04:51 [DEBUG   ] Got command BAM from MCS: ref #1181652
2019-01-16 03:04:51 [INFO    ] Finished processing BAM request
2019-01-16 03:04:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:04:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181652   8 58499 11091037 A  ERROR'
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 03:04:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 03:04:51 [DEBUG   ] spawn_process: at 2019-01-16 03:04:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 03:04:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:04:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:04:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:04:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-16 03:04:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 03:04:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:04:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:04:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:04:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:04:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:04:57 [DEBUG   ] Finished updating board flags in 1.003 seconds
2019-01-16 03:05:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:05:21 [DEBUG   ] Got command BAM from MCS: ref #1181654
2019-01-16 03:05:21 [INFO    ] Finished processing BAM request
2019-01-16 03:05:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:05:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181654   8 58499 11121021 A  ERROR'
2019-01-16 03:05:21 [DEBUG   ] Got command BAM from MCS: ref #1181653
2019-01-16 03:05:21 [INFO    ] Finished processing BAM request
2019-01-16 03:05:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:05:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181653   8 58499 11121025 A  ERROR'
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 03:05:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 03:05:21 [DEBUG   ] spawn_process: at 2019-01-16 03:05:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 03:05:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 03:05:51 [DEBUG   ] Got command BAM from MCS: ref #1181659
2019-01-16 03:05:51 [INFO    ] Finished processing BAM request
2019-01-16 03:05:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:05:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181659   8 58499 11151021 A  ERROR'
2019-01-16 03:05:51 [DEBUG   ] Got command BAM from MCS: ref #1181660
2019-01-16 03:05:51 [INFO    ] Finished processing BAM request
2019-01-16 03:05:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:05:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181660   8 58499 11151025 A  ERROR'
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 03:05:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 03:05:51 [DEBUG   ] spawn_process: at 2019-01-16 03:05:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 03:05:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:05:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-16 03:05:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:05:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:05:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-16 03:05:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:05:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:05:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:05:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:05:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:05:57 [DEBUG   ] Finished updating board flags in 1.025 seconds
2019-01-16 03:06:05 [DEBUG   ] Got command RPT from MCS: ref #1181661
2019-01-16 03:06:05 [DEBUG   ] summary = ERROR
2019-01-16 03:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181661  13 58499 11165193 A  ERRORERROR'
2019-01-16 03:06:05 [DEBUG   ] Got command RPT from MCS: ref #1181662
2019-01-16 03:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181662  77 58499 11165194 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:06:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:06:21 [DEBUG   ] Got command BAM from MCS: ref #1181679
2019-01-16 03:06:21 [INFO    ] Finished processing BAM request
2019-01-16 03:06:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:06:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181679   8 58499 11181025 A  ERROR'
2019-01-16 03:06:21 [DEBUG   ] Got command BAM from MCS: ref #1181678
2019-01-16 03:06:21 [INFO    ] Finished processing BAM request
2019-01-16 03:06:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:06:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181678   8 58499 11181029 A  ERROR'
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 03:06:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 03:06:21 [DEBUG   ] spawn_process: at 2019-01-16 03:06:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 03:06:33 [DEBUG   ] Got command RPT from MCS: ref #1181682
2019-01-16 03:06:33 [DEBUG   ] summary = ERROR
2019-01-16 03:06:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181682  13 58499 11193673 A  ERRORERROR'
2019-01-16 03:06:33 [DEBUG   ] Got command RPT from MCS: ref #1181683
2019-01-16 03:06:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:06:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181683  77 58499 11193877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:06:34 [DEBUG   ] Got command RPT from MCS: ref #1181684
2019-01-16 03:06:34 [DEBUG   ] summary = ERROR
2019-01-16 03:06:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181684  13 58499 11194081 A  ERRORERROR'
2019-01-16 03:06:34 [DEBUG   ] Got command RPT from MCS: ref #1181686
2019-01-16 03:06:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:06:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181686  77 58499 11194285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:06:34 [DEBUG   ] Got command RPT from MCS: ref #1181687
2019-01-16 03:06:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 03:06:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181687  12 58499 11194477 A  ERRORB¢ff'
2019-01-16 03:06:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:06:51 [DEBUG   ] Got command BAM from MCS: ref #1181693
2019-01-16 03:06:51 [INFO    ] Finished processing BAM request
2019-01-16 03:06:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:06:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181693   8 58499 11211025 A  ERROR'
2019-01-16 03:06:51 [DEBUG   ] Got command BAM from MCS: ref #1181692
2019-01-16 03:06:51 [INFO    ] Finished processing BAM request
2019-01-16 03:06:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:06:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181692   8 58499 11211029 A  ERROR'
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 03:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 03:06:51 [DEBUG   ] spawn_process: at 2019-01-16 03:06:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 03:06:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:06:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:06:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 03:06:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-16 03:06:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:06:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:06:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:06:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:06:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:06:57 [DEBUG   ] Finished updating board flags in 1.466 seconds
2019-01-16 03:07:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:07:21 [DEBUG   ] Got command BAM from MCS: ref #1181695
2019-01-16 03:07:21 [INFO    ] Finished processing BAM request
2019-01-16 03:07:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:07:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181695   8 58499 11241033 A  ERROR'
2019-01-16 03:07:21 [DEBUG   ] Got command BAM from MCS: ref #1181694
2019-01-16 03:07:21 [INFO    ] Finished processing BAM request
2019-01-16 03:07:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:07:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181694   8 58499 11241037 A  ERROR'
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 03:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 03:07:21 [DEBUG   ] spawn_process: at 2019-01-16 03:07:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 03:07:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:07:51 [DEBUG   ] Got command BAM from MCS: ref #1181696
2019-01-16 03:07:51 [INFO    ] Finished processing BAM request
2019-01-16 03:07:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:07:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181696   8 58499 11271033 A  ERROR'
2019-01-16 03:07:51 [DEBUG   ] Got command BAM from MCS: ref #1181697
2019-01-16 03:07:51 [INFO    ] Finished processing BAM request
2019-01-16 03:07:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:07:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181697   8 58499 11271037 A  ERROR'
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 03:07:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 03:07:51 [DEBUG   ] spawn_process: at 2019-01-16 03:07:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 03:07:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 03:07:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:07:57 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:07:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:07:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:07:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:07:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:07:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:07:57 [DEBUG   ] Finished updating board flags in 1.422 seconds
2019-01-16 03:08:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:08:21 [DEBUG   ] Got command BAM from MCS: ref #1181699
2019-01-16 03:08:21 [INFO    ] Finished processing BAM request
2019-01-16 03:08:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181699   8 58499 11301029 A  ERROR'
2019-01-16 03:08:21 [DEBUG   ] Got command BAM from MCS: ref #1181698
2019-01-16 03:08:21 [INFO    ] Finished processing BAM request
2019-01-16 03:08:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181698   8 58499 11301033 A  ERROR'
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 03:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 03:08:21 [DEBUG   ] spawn_process: at 2019-01-16 03:08:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 03:08:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:08:51 [DEBUG   ] Got command BAM from MCS: ref #1181704
2019-01-16 03:08:51 [INFO    ] Finished processing BAM request
2019-01-16 03:08:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:08:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181704   8 58499 11331029 A  ERROR'
2019-01-16 03:08:51 [DEBUG   ] Got command BAM from MCS: ref #1181705
2019-01-16 03:08:51 [INFO    ] Finished processing BAM request
2019-01-16 03:08:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:08:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181705   8 58499 11331033 A  ERROR'
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 03:08:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 03:08:51 [DEBUG   ] spawn_process: at 2019-01-16 03:08:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 03:08:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:08:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-16 03:08:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 03:08:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:08:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-16 03:08:57 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:08:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 03:08:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:08:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:08:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:08:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:08:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:08:57 [DEBUG   ] Finished updating board flags in 1.343 seconds
2019-01-16 03:09:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:09:21 [DEBUG   ] Got command BAM from MCS: ref #1181707
2019-01-16 03:09:21 [INFO    ] Finished processing BAM request
2019-01-16 03:09:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:09:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181707   8 58499 11361021 A  ERROR'
2019-01-16 03:09:21 [DEBUG   ] Got command BAM from MCS: ref #1181706
2019-01-16 03:09:21 [INFO    ] Finished processing BAM request
2019-01-16 03:09:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:09:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181706   8 58499 11361025 A  ERROR'
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 03:09:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 03:09:21 [DEBUG   ] spawn_process: at 2019-01-16 03:09:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 03:09:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:09:51 [DEBUG   ] Got command BAM from MCS: ref #1181708
2019-01-16 03:09:51 [INFO    ] Finished processing BAM request
2019-01-16 03:09:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:09:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181708   8 58499 11391033 A  ERROR'
2019-01-16 03:09:51 [DEBUG   ] Got command BAM from MCS: ref #1181709
2019-01-16 03:09:51 [INFO    ] Finished processing BAM request
2019-01-16 03:09:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:09:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181709   8 58499 11391037 A  ERROR'
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 03:09:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 03:09:51 [DEBUG   ] spawn_process: at 2019-01-16 03:09:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 03:09:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:09:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-16 03:09:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 03:09:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:09:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 03:09:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:09:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:09:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:09:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:09:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:09:57 [DEBUG   ] Finished updating board flags in 1.234 seconds
2019-01-16 03:10:15 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2019-01-16 03:10:21 [DEBUG   ] Got command BAM from MCS: ref #1181710
2019-01-16 03:10:21 [INFO    ] Finished processing BAM request
2019-01-16 03:10:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:10:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181710   8 58499 11421021 A  ERROR'
2019-01-16 03:10:21 [DEBUG   ] Got command BAM from MCS: ref #1181711
2019-01-16 03:10:21 [INFO    ] Finished processing BAM request
2019-01-16 03:10:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:10:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181711   8 58499 11421025 A  ERROR'
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 03:10:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 03:10:21 [DEBUG   ] spawn_process: at 2019-01-16 03:10:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 03:10:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 03:10:51 [DEBUG   ] Got command BAM from MCS: ref #1181712
2019-01-16 03:10:51 [INFO    ] Finished processing BAM request
2019-01-16 03:10:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:10:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181712   8 58499 11451029 A  ERROR'
2019-01-16 03:10:51 [DEBUG   ] Got command BAM from MCS: ref #1181713
2019-01-16 03:10:51 [INFO    ] Finished processing BAM request
2019-01-16 03:10:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:10:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181713   8 58499 11451033 A  ERROR'
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 03:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 03:10:51 [DEBUG   ] spawn_process: at 2019-01-16 03:10:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 03:10:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 03:10:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 03:10:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-16 03:10:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-16 03:10:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2019-01-16 03:10:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:10:57 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:10:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-16 03:10:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 03:10:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:10:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:10:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:10:57 [WARNING ] (13, 1, 'bot')
2019-01-16 03:10:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:10:57 [DEBUG   ] Finished updating board flags in 1.160 seconds
2019-01-16 03:11:05 [DEBUG   ] Got command RPT from MCS: ref #1181714
2019-01-16 03:11:05 [DEBUG   ] summary = ERROR
2019-01-16 03:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181714  13 58499 11465193 A  ERRORERROR'
2019-01-16 03:11:05 [DEBUG   ] Got command RPT from MCS: ref #1181715
2019-01-16 03:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181715  77 58499 11465194 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:11:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 03:11:21 [DEBUG   ] Got command BAM from MCS: ref #1181732
2019-01-16 03:11:21 [INFO    ] Finished processing BAM request
2019-01-16 03:11:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:11:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181732   8 58499 11481029 A  ERROR'
2019-01-16 03:11:21 [DEBUG   ] Got command BAM from MCS: ref #1181731
2019-01-16 03:11:21 [INFO    ] Finished processing BAM request
2019-01-16 03:11:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:11:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181731   8 58499 11481033 A  ERROR'
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 03:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 03:11:21 [DEBUG   ] spawn_process: at 2019-01-16 03:11:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 03:11:33 [DEBUG   ] Got command RPT from MCS: ref #1181733
2019-01-16 03:11:33 [DEBUG   ] summary = ERROR
2019-01-16 03:11:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181733  13 58499 11493765 A  ERRORERROR'
2019-01-16 03:11:33 [DEBUG   ] Got command RPT from MCS: ref #1181734
2019-01-16 03:11:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:11:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181734  77 58499 11493969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:11:34 [DEBUG   ] Got command RPT from MCS: ref #1181735
2019-01-16 03:11:34 [DEBUG   ] summary = ERROR
2019-01-16 03:11:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181735  13 58499 11494173 A  ERRORERROR'
2019-01-16 03:11:34 [DEBUG   ] Got command RPT from MCS: ref #1181736
2019-01-16 03:11:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:11:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181736  77 58499 11494365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:11:34 [DEBUG   ] Got command RPT from MCS: ref #1181737
2019-01-16 03:11:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 03:11:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181737  12 58499 11494569 A  ERRORB¤ff'
2019-01-16 03:11:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 03:11:51 [DEBUG   ] Got command BAM from MCS: ref #1181743
2019-01-16 03:11:51 [INFO    ] Finished processing BAM request
2019-01-16 03:11:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:11:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181743   8 58499 11511025 A  ERROR'
2019-01-16 03:11:51 [DEBUG   ] Got command BAM from MCS: ref #1181742
2019-01-16 03:11:51 [INFO    ] Finished processing BAM request
2019-01-16 03:11:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:11:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181742   8 58499 11511029 A  ERROR'
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 03:11:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 03:11:51 [DEBUG   ] spawn_process: at 2019-01-16 03:11:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 03:11:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 03:11:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2019-01-16 03:11:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-16 03:11:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:11:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 03:11:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-16 03:11:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:11:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-16 03:11:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 03:11:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:11:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:11:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:11:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:11:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:11:58 [DEBUG   ] Finished updating board flags in 1.563 seconds
2019-01-16 03:12:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 03:12:21 [DEBUG   ] Got command BAM from MCS: ref #1181745
2019-01-16 03:12:21 [INFO    ] Finished processing BAM request
2019-01-16 03:12:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:12:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181745   8 58499 11541025 A  ERROR'
2019-01-16 03:12:21 [DEBUG   ] Got command BAM from MCS: ref #1181744
2019-01-16 03:12:21 [INFO    ] Finished processing BAM request
2019-01-16 03:12:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:12:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181744   8 58499 11541029 A  ERROR'
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 03:12:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 03:12:21 [DEBUG   ] spawn_process: at 2019-01-16 03:12:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 03:12:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 03:12:51 [DEBUG   ] Got command BAM from MCS: ref #1181746
2019-01-16 03:12:51 [INFO    ] Finished processing BAM request
2019-01-16 03:12:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:12:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181746   8 58499 11571021 A  ERROR'
2019-01-16 03:12:51 [DEBUG   ] Got command BAM from MCS: ref #1181747
2019-01-16 03:12:51 [INFO    ] Finished processing BAM request
2019-01-16 03:12:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:12:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181747   8 58499 11571025 A  ERROR'
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 03:12:51 [DEBUG   ] spawn_process: at 2019-01-16 03:12:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 03:12:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 03:12:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:12:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:12:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-16 03:12:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 03:12:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:12:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:12:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:12:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:12:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:12:58 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-01-16 03:13:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 03:13:21 [DEBUG   ] Got command BAM from MCS: ref #1181748
2019-01-16 03:13:21 [INFO    ] Finished processing BAM request
2019-01-16 03:13:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181748   8 58499 11601021 A  ERROR'
2019-01-16 03:13:21 [DEBUG   ] Got command BAM from MCS: ref #1181749
2019-01-16 03:13:21 [INFO    ] Finished processing BAM request
2019-01-16 03:13:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181749   8 58499 11601025 A  ERROR'
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 03:13:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 03:13:21 [DEBUG   ] spawn_process: at 2019-01-16 03:13:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 03:13:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 03:13:51 [DEBUG   ] Got command BAM from MCS: ref #1181750
2019-01-16 03:13:51 [INFO    ] Finished processing BAM request
2019-01-16 03:13:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:13:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181750   8 58499 11631025 A  ERROR'
2019-01-16 03:13:51 [DEBUG   ] Got command BAM from MCS: ref #1181751
2019-01-16 03:13:51 [INFO    ] Finished processing BAM request
2019-01-16 03:13:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:13:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181751   8 58499 11631029 A  ERROR'
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 03:13:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 03:13:51 [DEBUG   ] spawn_process: at 2019-01-16 03:13:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 03:13:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 03:13:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 03:13:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:13:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-16 03:13:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 03:13:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 03:13:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 03:13:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:13:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:13:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:13:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:13:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:13:58 [DEBUG   ] Finished updating board flags in 1.387 seconds
2019-01-16 03:14:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 03:14:21 [DEBUG   ] Got command BAM from MCS: ref #1181752
2019-01-16 03:14:21 [INFO    ] Finished processing BAM request
2019-01-16 03:14:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:14:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181752   8 58499 11661025 A  ERROR'
2019-01-16 03:14:21 [DEBUG   ] Got command BAM from MCS: ref #1181753
2019-01-16 03:14:21 [INFO    ] Finished processing BAM request
2019-01-16 03:14:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:14:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181753   8 58499 11661029 A  ERROR'
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 03:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 03:14:21 [DEBUG   ] spawn_process: at 2019-01-16 03:14:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 03:14:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 03:14:51 [DEBUG   ] Got command BAM from MCS: ref #1181759
2019-01-16 03:14:51 [INFO    ] Finished processing BAM request
2019-01-16 03:14:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:14:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181759   8 58499 11691029 A  ERROR'
2019-01-16 03:14:51 [DEBUG   ] Got command BAM from MCS: ref #1181758
2019-01-16 03:14:51 [INFO    ] Finished processing BAM request
2019-01-16 03:14:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:14:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181758   8 58499 11691033 A  ERROR'
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 03:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 03:14:51 [DEBUG   ] spawn_process: at 2019-01-16 03:14:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 03:14:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 03:14:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 03:14:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:14:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 03:14:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 03:14:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:14:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:14:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:14:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:14:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:14:58 [DEBUG   ] Finished updating board flags in 1.219 seconds
2019-01-16 03:15:15 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-16 03:15:21 [DEBUG   ] Got command BAM from MCS: ref #1181761
2019-01-16 03:15:21 [INFO    ] Finished processing BAM request
2019-01-16 03:15:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:15:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181761   8 58499 11721029 A  ERROR'
2019-01-16 03:15:21 [DEBUG   ] Got command BAM from MCS: ref #1181760
2019-01-16 03:15:21 [INFO    ] Finished processing BAM request
2019-01-16 03:15:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:15:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181760   8 58499 11721033 A  ERROR'
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 03:15:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 03:15:21 [DEBUG   ] spawn_process: at 2019-01-16 03:15:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 03:15:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-16 03:15:51 [DEBUG   ] Got command BAM from MCS: ref #1181763
2019-01-16 03:15:51 [INFO    ] Finished processing BAM request
2019-01-16 03:15:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:15:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181763   8 58499 11751029 A  ERROR'
2019-01-16 03:15:51 [DEBUG   ] Got command BAM from MCS: ref #1181762
2019-01-16 03:15:51 [INFO    ] Finished processing BAM request
2019-01-16 03:15:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:15:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181762   8 58499 11751033 A  ERROR'
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 03:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 03:15:51 [DEBUG   ] spawn_process: at 2019-01-16 03:15:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 03:15:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 03:15:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:15:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 03:15:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:15:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:15:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:15:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:15:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:15:58 [DEBUG   ] Finished updating board flags in 1.183 seconds
2019-01-16 03:16:05 [DEBUG   ] Got command RPT from MCS: ref #1181764
2019-01-16 03:16:05 [DEBUG   ] summary = ERROR
2019-01-16 03:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181764  13 58499 11765189 A  ERRORERROR'
2019-01-16 03:16:05 [DEBUG   ] Got command RPT from MCS: ref #1181765
2019-01-16 03:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181765  77 58499 11765190 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:16:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 03:16:21 [DEBUG   ] Got command BAM from MCS: ref #1181781
2019-01-16 03:16:21 [INFO    ] Finished processing BAM request
2019-01-16 03:16:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:16:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181781   8 58499 11781033 A  ERROR'
2019-01-16 03:16:21 [DEBUG   ] Got command BAM from MCS: ref #1181782
2019-01-16 03:16:21 [INFO    ] Finished processing BAM request
2019-01-16 03:16:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:16:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181782   8 58499 11781037 A  ERROR'
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 03:16:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 03:16:21 [DEBUG   ] spawn_process: at 2019-01-16 03:16:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 03:16:33 [DEBUG   ] Got command RPT from MCS: ref #1181785
2019-01-16 03:16:33 [DEBUG   ] summary = ERROR
2019-01-16 03:16:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181785  13 58499 11793857 A  ERRORERROR'
2019-01-16 03:16:34 [DEBUG   ] Got command RPT from MCS: ref #1181786
2019-01-16 03:16:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:16:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181786  77 58499 11794049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:16:34 [DEBUG   ] Got command RPT from MCS: ref #1181787
2019-01-16 03:16:34 [DEBUG   ] summary = ERROR
2019-01-16 03:16:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181787  13 58499 11794253 A  ERRORERROR'
2019-01-16 03:16:34 [DEBUG   ] Got command RPT from MCS: ref #1181789
2019-01-16 03:16:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:16:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181789  77 58499 11794457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:16:34 [DEBUG   ] Got command RPT from MCS: ref #1181790
2019-01-16 03:16:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 03:16:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181790  12 58499 11794649 A  ERRORB£ff'
2019-01-16 03:16:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 03:16:51 [DEBUG   ] Got command BAM from MCS: ref #1181796
2019-01-16 03:16:51 [INFO    ] Finished processing BAM request
2019-01-16 03:16:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:16:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181796   8 58499 11811033 A  ERROR'
2019-01-16 03:16:51 [DEBUG   ] Got command BAM from MCS: ref #1181795
2019-01-16 03:16:51 [INFO    ] Finished processing BAM request
2019-01-16 03:16:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:16:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181795   8 58499 11811037 A  ERROR'
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 03:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 03:16:51 [DEBUG   ] spawn_process: at 2019-01-16 03:16:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 03:16:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 03:16:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-01-16 03:16:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:16:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 03:16:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-16 03:16:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:16:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:16:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:16:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:16:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:16:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:16:58 [DEBUG   ] Finished updating board flags in 1.077 seconds
2019-01-16 03:17:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 03:17:21 [DEBUG   ] Got command BAM from MCS: ref #1181798
2019-01-16 03:17:21 [INFO    ] Finished processing BAM request
2019-01-16 03:17:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:17:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181798   8 58499 11841033 A  ERROR'
2019-01-16 03:17:21 [DEBUG   ] Got command BAM from MCS: ref #1181797
2019-01-16 03:17:21 [INFO    ] Finished processing BAM request
2019-01-16 03:17:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:17:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181797   8 58499 11841037 A  ERROR'
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 03:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 03:17:21 [DEBUG   ] spawn_process: at 2019-01-16 03:17:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 03:17:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 03:17:51 [DEBUG   ] Got command BAM from MCS: ref #1181803
2019-01-16 03:17:51 [INFO    ] Finished processing BAM request
2019-01-16 03:17:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:17:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181803   8 58499 11871029 A  ERROR'
2019-01-16 03:17:51 [DEBUG   ] Got command BAM from MCS: ref #1181804
2019-01-16 03:17:51 [INFO    ] Finished processing BAM request
2019-01-16 03:17:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:17:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181804   8 58499 11871033 A  ERROR'
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 03:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 03:17:51 [DEBUG   ] spawn_process: at 2019-01-16 03:17:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 03:17:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 03:17:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:17:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 03:17:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:17:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:17:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:17:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:17:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:17:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:17:59 [DEBUG   ] Finished updating board flags in 2.005 seconds
2019-01-16 03:18:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 03:18:21 [DEBUG   ] Got command BAM from MCS: ref #1181805
2019-01-16 03:18:21 [INFO    ] Finished processing BAM request
2019-01-16 03:18:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:18:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181805   8 58499 11901029 A  ERROR'
2019-01-16 03:18:21 [DEBUG   ] Got command BAM from MCS: ref #1181806
2019-01-16 03:18:21 [INFO    ] Finished processing BAM request
2019-01-16 03:18:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:18:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181806   8 58499 11901033 A  ERROR'
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 03:18:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 03:18:21 [DEBUG   ] spawn_process: at 2019-01-16 03:18:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 03:18:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 03:18:53 [DEBUG   ] Got command STP from MCS: ref #1181807
2019-01-16 03:18:53 [INFO    ] Finished processing BAM request
2019-01-16 03:18:53 [INFO    ] Shutdown the adder chain on beam #2
2019-01-16 03:18:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP  1181807   8 58499 11933029 A  ERROR'
2019-01-16 03:18:53 [DEBUG   ] Got command STP from MCS: ref #1181808
2019-01-16 03:18:53 [INFO    ] Finished processing BAM request
2019-01-16 03:18:53 [INFO    ] Shutdown the adder chain on beam #3
2019-01-16 03:18:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP  1181808   8 58499 11933033 A  ERROR'
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 03:18:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 03:18:53 [DEBUG   ] spawn_process: at 2019-01-16 03:18:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 03:18:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 03:18:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:18:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 03:18:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:18:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:18:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:18:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:18:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:18:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:18:58 [DEBUG   ] Finished updating board flags in 1.387 seconds
2019-01-16 03:19:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 03:19:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 03:19:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 03:19:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:19:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:19:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:19:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:19:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:19:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:19:58 [DEBUG   ] Finished updating board flags in 1.202 seconds
2019-01-16 03:20:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 03:20:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 03:20:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 03:20:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:20:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:20:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:20:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:20:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:20:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:20:58 [DEBUG   ] Finished updating board flags in 1.213 seconds
2019-01-16 03:21:05 [DEBUG   ] Got command RPT from MCS: ref #1181813
2019-01-16 03:21:05 [DEBUG   ] summary = ERROR
2019-01-16 03:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181813  13 58499 12065197 A  ERRORERROR'
2019-01-16 03:21:05 [DEBUG   ] Got command RPT from MCS: ref #1181814
2019-01-16 03:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181814  77 58499 12065198 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:21:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 03:21:33 [DEBUG   ] Got command RPT from MCS: ref #1181830
2019-01-16 03:21:33 [DEBUG   ] summary = ERROR
2019-01-16 03:21:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181830  13 58499 12093941 A  ERRORERROR'
2019-01-16 03:21:34 [DEBUG   ] Got command RPT from MCS: ref #1181831
2019-01-16 03:21:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:21:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181831  77 58499 12094145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:21:34 [DEBUG   ] Got command RPT from MCS: ref #1181832
2019-01-16 03:21:34 [DEBUG   ] summary = ERROR
2019-01-16 03:21:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181832  13 58499 12094337 A  ERRORERROR'
2019-01-16 03:21:34 [DEBUG   ] Got command RPT from MCS: ref #1181833
2019-01-16 03:21:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:21:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181833  77 58499 12094541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:21:34 [DEBUG   ] Got command RPT from MCS: ref #1181834
2019-01-16 03:21:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 03:21:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181834  12 58499 12094745 A  ERRORBš™š'
2019-01-16 03:21:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 03:21:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 03:21:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:21:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:21:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:21:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:21:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:21:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:21:58 [DEBUG   ] Finished updating board flags in 1.167 seconds
2019-01-16 03:22:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 03:22:36 [DEBUG   ] Got command DRX from MCS: ref #1181840
2019-01-16 03:22:36 [INFO    ] sending drx command to lwa16
2019-01-16 03:22:36 [DEBUG   ] run_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 1 64500000.0 7 9 0']
2019-01-16 03:22:36 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-16 03:22:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1181840   8 58499 12156009 A  ERROR'
2019-01-16 03:22:36 [DEBUG   ] Got command DRX from MCS: ref #1181839
2019-01-16 03:22:36 [INFO    ] sending drx command to lwa34
2019-01-16 03:22:36 [DEBUG   ] run_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 35100000.0 7 9 0']
2019-01-16 03:22:36 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-16 03:22:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1181839   8 58499 12156013 A  ERROR'
2019-01-16 03:22:36 [DEBUG   ] Got command DRX from MCS: ref #1181841
2019-01-16 03:22:36 [INFO    ] sending drx command to lwa34
2019-01-16 03:22:36 [DEBUG   ] run_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 49800000.0 7 9 0']
2019-01-16 03:22:36 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-16 03:22:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1181841   8 58499 12156017 A  ERROR'
2019-01-16 03:22:36 [DEBUG   ] Got command DRX from MCS: ref #1181842
2019-01-16 03:22:36 [INFO    ] sending drx command to lwa16
2019-01-16 03:22:36 [DEBUG   ] run_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 2 79200000.0 7 9 0']
2019-01-16 03:22:36 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-16 03:22:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1181842   8 58499 12156025 A  ERROR'
2019-01-16 03:22:36 [DEBUG   ] Got command BAM from MCS: ref #1181843
2019-01-16 03:22:36 [INFO    ] Finished processing BAM request
2019-01-16 03:22:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:22:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181843   8 58499 12156033 A  ERROR'
2019-01-16 03:22:36 [DEBUG   ] Got command BAM from MCS: ref #1181844
2019-01-16 03:22:36 [INFO    ] Finished processing BAM request
2019-01-16 03:22:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:22:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181844   8 58499 12156041 A  ERROR'
2019-01-16 03:22:36 [INFO    ] Finished starting DRX
2019-01-16 03:22:36 [INFO    ] Finished starting DRX
2019-01-16 03:22:36 [INFO    ] Finished starting DRX
2019-01-16 03:22:36 [INFO    ] Finished starting DRX
2019-01-16 03:22:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 03:22:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 03:22:36 [DEBUG   ] spawn_process: at 2019-01-16 03:22:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 03:22:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 03:22:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:22:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:22:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:22:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:22:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:22:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:22:59 [DEBUG   ] Finished updating board flags in 1.642 seconds
2019-01-16 03:23:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 03:23:19 [DEBUG   ] Got command BAM from MCS: ref #1181848
2019-01-16 03:23:19 [INFO    ] Finished processing BAM request
2019-01-16 03:23:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:23:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181848   8 58499 12199029 A  ERROR'
2019-01-16 03:23:19 [DEBUG   ] Got command BAM from MCS: ref #1181847
2019-01-16 03:23:19 [INFO    ] Finished processing BAM request
2019-01-16 03:23:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:23:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181847   8 58499 12199033 A  ERROR'
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 03:23:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 03:23:19 [DEBUG   ] spawn_process: at 2019-01-16 03:23:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 03:23:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 03:23:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 03:23:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 03:23:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:23:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:23:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:23:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:23:58 [WARNING ] (13, 1, 'bot')
2019-01-16 03:23:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:23:58 [DEBUG   ] Finished updating board flags in 0.987 seconds
2019-01-16 03:24:02 [DEBUG   ] Got command BAM from MCS: ref #1181854
2019-01-16 03:24:02 [INFO    ] Finished processing BAM request
2019-01-16 03:24:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:24:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181854   8 58499 12242025 A  ERROR'
2019-01-16 03:24:02 [DEBUG   ] Got command BAM from MCS: ref #1181853
2019-01-16 03:24:02 [INFO    ] Finished processing BAM request
2019-01-16 03:24:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:24:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181853   8 58499 12242029 A  ERROR'
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 03:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 03:24:02 [DEBUG   ] spawn_process: at 2019-01-16 03:24:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 03:24:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-16 03:24:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 03:24:45 [DEBUG   ] Got command BAM from MCS: ref #1181856
2019-01-16 03:24:45 [INFO    ] Finished processing BAM request
2019-01-16 03:24:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:24:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181856   8 58499 12285025 A  ERROR'
2019-01-16 03:24:45 [DEBUG   ] Got command BAM from MCS: ref #1181855
2019-01-16 03:24:45 [INFO    ] Finished processing BAM request
2019-01-16 03:24:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:24:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181855   8 58499 12285029 A  ERROR'
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 03:24:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 03:24:45 [DEBUG   ] spawn_process: at 2019-01-16 03:24:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 03:24:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 03:24:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:24:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:24:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:24:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:24:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:24:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:24:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:24:59 [DEBUG   ] Finished updating board flags in 1.351 seconds
2019-01-16 03:25:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 03:25:28 [DEBUG   ] Got command BAM from MCS: ref #1181857
2019-01-16 03:25:28 [INFO    ] Finished processing BAM request
2019-01-16 03:25:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:25:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181857   8 58499 12328025 A  ERROR'
2019-01-16 03:25:28 [DEBUG   ] Got command BAM from MCS: ref #1181858
2019-01-16 03:25:28 [INFO    ] Finished processing BAM request
2019-01-16 03:25:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:25:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181858   8 58499 12328029 A  ERROR'
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 03:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 03:25:28 [DEBUG   ] spawn_process: at 2019-01-16 03:25:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 03:25:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 03:25:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 03:25:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:25:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:25:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 03:25:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:25:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:25:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:25:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:25:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:25:59 [DEBUG   ] Finished updating board flags in 1.210 seconds
2019-01-16 03:26:05 [DEBUG   ] Got command RPT from MCS: ref #1181859
2019-01-16 03:26:05 [DEBUG   ] summary = ERROR
2019-01-16 03:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181859  13 58499 12365193 A  ERRORERROR'
2019-01-16 03:26:05 [DEBUG   ] Got command RPT from MCS: ref #1181860
2019-01-16 03:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181860  77 58499 12365194 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:26:10 [DEBUG   ] Got command BAM from MCS: ref #1181876
2019-01-16 03:26:10 [INFO    ] Finished processing BAM request
2019-01-16 03:26:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:26:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181876   8 58499 12370033 A  ERROR'
2019-01-16 03:26:10 [DEBUG   ] Got command BAM from MCS: ref #1181877
2019-01-16 03:26:10 [INFO    ] Finished processing BAM request
2019-01-16 03:26:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:26:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181877   8 58499 12370037 A  ERROR'
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 03:26:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 03:26:10 [DEBUG   ] spawn_process: at 2019-01-16 03:26:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 03:26:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 03:26:34 [DEBUG   ] Got command RPT from MCS: ref #1181880
2019-01-16 03:26:34 [DEBUG   ] summary = ERROR
2019-01-16 03:26:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181880  13 58499 12394055 A  ERRORERROR'
2019-01-16 03:26:34 [DEBUG   ] Got command RPT from MCS: ref #1181881
2019-01-16 03:26:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:26:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181881  77 58499 12394233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:26:34 [DEBUG   ] Got command RPT from MCS: ref #1181882
2019-01-16 03:26:34 [DEBUG   ] summary = ERROR
2019-01-16 03:26:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181882  13 58499 12394425 A  ERRORERROR'
2019-01-16 03:26:34 [DEBUG   ] Got command RPT from MCS: ref #1181884
2019-01-16 03:26:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:26:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181884  77 58499 12394629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:26:34 [DEBUG   ] Got command RPT from MCS: ref #1181885
2019-01-16 03:26:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 03:26:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181885  12 58499 12394833 A  ERRORB ff'
2019-01-16 03:26:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 03:26:52 [DEBUG   ] Got command BAM from MCS: ref #1181895
2019-01-16 03:26:52 [INFO    ] Finished processing BAM request
2019-01-16 03:26:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:26:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181895   8 58499 12412025 A  ERROR'
2019-01-16 03:26:52 [DEBUG   ] Got command BAM from MCS: ref #1181894
2019-01-16 03:26:52 [INFO    ] Finished processing BAM request
2019-01-16 03:26:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:26:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181894   8 58499 12412029 A  ERROR'
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 03:26:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 03:26:52 [DEBUG   ] spawn_process: at 2019-01-16 03:26:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 03:26:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 03:26:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 03:26:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:26:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:26:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-01-16 03:26:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:26:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:26:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:26:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:26:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:26:59 [DEBUG   ] Finished updating board flags in 1.188 seconds
2019-01-16 03:27:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 03:27:34 [DEBUG   ] Got command BAM from MCS: ref #1181896
2019-01-16 03:27:34 [INFO    ] Finished processing BAM request
2019-01-16 03:27:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:27:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181896   8 58499 12454033 A  ERROR'
2019-01-16 03:27:34 [DEBUG   ] Got command BAM from MCS: ref #1181897
2019-01-16 03:27:34 [INFO    ] Finished processing BAM request
2019-01-16 03:27:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:27:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181897   8 58499 12454037 A  ERROR'
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 03:27:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 03:27:34 [DEBUG   ] spawn_process: at 2019-01-16 03:27:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 03:27:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 03:27:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 03:27:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:27:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:27:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:27:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:27:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:27:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:27:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:27:59 [DEBUG   ] Finished updating board flags in 1.007 seconds
2019-01-16 03:28:16 [DEBUG   ] Got command BAM from MCS: ref #1181899
2019-01-16 03:28:16 [INFO    ] Finished processing BAM request
2019-01-16 03:28:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:28:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181899   8 58499 12496033 A  ERROR'
2019-01-16 03:28:16 [DEBUG   ] Got command BAM from MCS: ref #1181898
2019-01-16 03:28:16 [INFO    ] Finished processing BAM request
2019-01-16 03:28:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:28:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181898   8 58499 12496037 A  ERROR'
2019-01-16 03:28:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 03:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 03:28:16 [DEBUG   ] spawn_process: at 2019-01-16 03:28:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 03:28:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 03:28:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 03:28:58 [DEBUG   ] Got command BAM from MCS: ref #1181901
2019-01-16 03:28:58 [INFO    ] Finished processing BAM request
2019-01-16 03:28:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:28:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181901   8 58499 12538025 A  ERROR'
2019-01-16 03:28:58 [DEBUG   ] Got command BAM from MCS: ref #1181900
2019-01-16 03:28:58 [INFO    ] Finished processing BAM request
2019-01-16 03:28:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:28:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181900   8 58499 12538029 A  ERROR'
2019-01-16 03:28:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 03:28:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 03:28:58 [DEBUG   ] spawn_process: at 2019-01-16 03:28:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 03:28:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-16 03:28:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 03:28:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 03:28:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:28:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:28:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:28:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:28:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:28:59 [DEBUG   ] Finished updating board flags in 1.011 seconds
2019-01-16 03:29:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 03:29:37 [DEBUG   ] Finished updating ant stats in 1.797 seconds
2019-01-16 03:29:40 [DEBUG   ] Got command BAM from MCS: ref #1181902
2019-01-16 03:29:40 [INFO    ] Finished processing BAM request
2019-01-16 03:29:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:29:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181902   8 58499 12580029 A  ERROR'
2019-01-16 03:29:40 [DEBUG   ] Got command BAM from MCS: ref #1181903
2019-01-16 03:29:40 [INFO    ] Finished processing BAM request
2019-01-16 03:29:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:29:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181903   8 58499 12580033 A  ERROR'
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 03:29:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 03:29:40 [DEBUG   ] spawn_process: at 2019-01-16 03:29:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 03:29:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 03:29:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:29:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:29:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:29:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:29:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:29:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:29:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:29:59 [DEBUG   ] Finished updating board flags in 1.075 seconds
2019-01-16 03:30:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:30:22 [DEBUG   ] Got command BAM from MCS: ref #1181908
2019-01-16 03:30:22 [INFO    ] Finished processing BAM request
2019-01-16 03:30:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:30:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181908   8 58499 12622033 A  ERROR'
2019-01-16 03:30:22 [DEBUG   ] Got command BAM from MCS: ref #1181909
2019-01-16 03:30:22 [INFO    ] Finished processing BAM request
2019-01-16 03:30:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:30:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181909   8 58499 12622037 A  ERROR'
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 03:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 03:30:22 [DEBUG   ] spawn_process: at 2019-01-16 03:30:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 03:30:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:30:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:30:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:31:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:31:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:31:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:31:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:31:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:31:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:31:00 [DEBUG   ] Finished updating board flags in 2.004 seconds
2019-01-16 03:31:04 [DEBUG   ] Got command BAM from MCS: ref #1181910
2019-01-16 03:31:04 [INFO    ] Finished processing BAM request
2019-01-16 03:31:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181910   8 58499 12664037 A  ERROR'
2019-01-16 03:31:04 [DEBUG   ] Got command BAM from MCS: ref #1181911
2019-01-16 03:31:04 [INFO    ] Finished processing BAM request
2019-01-16 03:31:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:31:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181911   8 58499 12664045 A  ERROR'
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 03:31:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 03:31:04 [DEBUG   ] spawn_process: at 2019-01-16 03:31:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 03:31:05 [DEBUG   ] Got command RPT from MCS: ref #1181912
2019-01-16 03:31:05 [DEBUG   ] summary = ERROR
2019-01-16 03:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181912  13 58499 12665197 A  ERRORERROR'
2019-01-16 03:31:05 [DEBUG   ] Got command RPT from MCS: ref #1181913
2019-01-16 03:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181913  77 58499 12665198 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:31:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:31:34 [DEBUG   ] Got command RPT from MCS: ref #1181929
2019-01-16 03:31:34 [DEBUG   ] summary = ERROR
2019-01-16 03:31:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181929  13 58499 12694114 A  ERRORERROR'
2019-01-16 03:31:34 [DEBUG   ] Got command RPT from MCS: ref #1181930
2019-01-16 03:31:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:31:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181930  77 58499 12694317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:31:34 [DEBUG   ] Got command RPT from MCS: ref #1181931
2019-01-16 03:31:34 [DEBUG   ] summary = ERROR
2019-01-16 03:31:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181931  13 58499 12694521 A  ERRORERROR'
2019-01-16 03:31:34 [DEBUG   ] Got command RPT from MCS: ref #1181932
2019-01-16 03:31:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:31:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181932  77 58499 12694713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:31:34 [DEBUG   ] Got command RPT from MCS: ref #1181933
2019-01-16 03:31:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 03:31:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181933  12 58499 12694917 A  ERRORB¢ff'
2019-01-16 03:31:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:31:46 [DEBUG   ] Got command BAM from MCS: ref #1181935
2019-01-16 03:31:46 [INFO    ] Finished processing BAM request
2019-01-16 03:31:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:31:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181935   8 58499 12706033 A  ERROR'
2019-01-16 03:31:46 [DEBUG   ] Got command BAM from MCS: ref #1181934
2019-01-16 03:31:46 [INFO    ] Finished processing BAM request
2019-01-16 03:31:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:31:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181934   8 58499 12706041 A  ERROR'
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 03:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 03:31:46 [DEBUG   ] spawn_process: at 2019-01-16 03:31:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 03:31:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:31:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:32:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 03:32:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-16 03:32:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:32:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:32:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:32:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:32:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:32:00 [DEBUG   ] Finished updating board flags in 1.917 seconds
2019-01-16 03:32:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-16 03:32:28 [DEBUG   ] Got command BAM from MCS: ref #1181937
2019-01-16 03:32:28 [INFO    ] Finished processing BAM request
2019-01-16 03:32:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:32:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181937   8 58499 12748029 A  ERROR'
2019-01-16 03:32:28 [DEBUG   ] Got command BAM from MCS: ref #1181936
2019-01-16 03:32:28 [INFO    ] Finished processing BAM request
2019-01-16 03:32:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:32:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181936   8 58499 12748033 A  ERROR'
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 03:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 03:32:28 [DEBUG   ] spawn_process: at 2019-01-16 03:32:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 03:32:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 03:32:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 03:32:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 03:32:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 4
2019-01-16 03:32:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:32:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:32:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:32:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:32:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:32:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:32:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:32:59 [DEBUG   ] Finished updating board flags in 1.281 seconds
2019-01-16 03:33:10 [DEBUG   ] Got command BAM from MCS: ref #1181943
2019-01-16 03:33:10 [INFO    ] Finished processing BAM request
2019-01-16 03:33:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:33:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181943   8 58499 12790029 A  ERROR'
2019-01-16 03:33:10 [DEBUG   ] Got command BAM from MCS: ref #1181942
2019-01-16 03:33:10 [INFO    ] Finished processing BAM request
2019-01-16 03:33:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:33:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181942   8 58499 12790033 A  ERROR'
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 03:33:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 03:33:10 [DEBUG   ] spawn_process: at 2019-01-16 03:33:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 03:33:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 03:33:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 03:33:52 [DEBUG   ] Got command BAM from MCS: ref #1181945
2019-01-16 03:33:52 [INFO    ] Finished processing BAM request
2019-01-16 03:33:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:33:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181945   8 58499 12832033 A  ERROR'
2019-01-16 03:33:52 [DEBUG   ] Got command BAM from MCS: ref #1181944
2019-01-16 03:33:52 [INFO    ] Finished processing BAM request
2019-01-16 03:33:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:33:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181944   8 58499 12832037 A  ERROR'
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 03:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 03:33:52 [DEBUG   ] spawn_process: at 2019-01-16 03:33:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 03:33:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 03:33:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:33:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-01-16 03:33:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:33:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:33:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:33:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:33:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:33:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:33:59 [DEBUG   ] Finished updating board flags in 1.174 seconds
2019-01-16 03:34:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 03:34:34 [DEBUG   ] Got command BAM from MCS: ref #1181946
2019-01-16 03:34:34 [INFO    ] Finished processing BAM request
2019-01-16 03:34:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:34:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181946   8 58499 12874033 A  ERROR'
2019-01-16 03:34:34 [DEBUG   ] Got command BAM from MCS: ref #1181947
2019-01-16 03:34:34 [INFO    ] Finished processing BAM request
2019-01-16 03:34:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:34:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181947   8 58499 12874037 A  ERROR'
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 03:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 03:34:34 [DEBUG   ] spawn_process: at 2019-01-16 03:34:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 03:34:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 03:34:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 03:34:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:34:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-16 03:34:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:34:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:34:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:34:59 [WARNING ] (13, 1, 'bot')
2019-01-16 03:34:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:34:59 [DEBUG   ] Finished updating board flags in 0.997 seconds
2019-01-16 03:35:16 [DEBUG   ] Got command BAM from MCS: ref #1181948
2019-01-16 03:35:16 [INFO    ] Finished processing BAM request
2019-01-16 03:35:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:35:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181948   8 58499 12916025 A  ERROR'
2019-01-16 03:35:16 [DEBUG   ] Got command BAM from MCS: ref #1181949
2019-01-16 03:35:16 [INFO    ] Finished processing BAM request
2019-01-16 03:35:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:35:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181949   8 58499 12916029 A  ERROR'
2019-01-16 03:35:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 03:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 03:35:16 [DEBUG   ] spawn_process: at 2019-01-16 03:35:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 03:35:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 03:35:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 03:35:58 [DEBUG   ] Got command BAM from MCS: ref #1181955
2019-01-16 03:35:58 [INFO    ] Finished processing BAM request
2019-01-16 03:35:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181955   8 58499 12958033 A  ERROR'
2019-01-16 03:35:58 [DEBUG   ] Got command BAM from MCS: ref #1181954
2019-01-16 03:35:58 [INFO    ] Finished processing BAM request
2019-01-16 03:35:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181954   8 58499 12958037 A  ERROR'
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 03:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 03:35:58 [DEBUG   ] spawn_process: at 2019-01-16 03:35:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 03:35:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 03:35:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 03:35:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-16 03:35:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 03:35:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:35:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 03:36:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:36:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:36:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:36:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:36:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:36:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:36:00 [DEBUG   ] Finished updating board flags in 1.363 seconds
2019-01-16 03:36:05 [DEBUG   ] Got command RPT from MCS: ref #1181956
2019-01-16 03:36:05 [DEBUG   ] summary = ERROR
2019-01-16 03:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181956  13 58499 12965197 A  ERRORERROR'
2019-01-16 03:36:05 [DEBUG   ] Got command RPT from MCS: ref #1181957
2019-01-16 03:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181957  77 58499 12965198 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:36:16 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-16 03:36:34 [DEBUG   ] Got command RPT from MCS: ref #1181975
2019-01-16 03:36:34 [DEBUG   ] summary = ERROR
2019-01-16 03:36:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181975  13 58499 12994209 A  ERRORERROR'
2019-01-16 03:36:34 [DEBUG   ] Got command RPT from MCS: ref #1181976
2019-01-16 03:36:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:36:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181976  77 58499 12994401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:36:34 [DEBUG   ] Got command RPT from MCS: ref #1181977
2019-01-16 03:36:34 [DEBUG   ] summary = ERROR
2019-01-16 03:36:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181977  13 58499 12994605 A  ERRORERROR'
2019-01-16 03:36:34 [DEBUG   ] Got command RPT from MCS: ref #1181979
2019-01-16 03:36:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:36:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181979  77 58499 12994809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:36:35 [DEBUG   ] Got command RPT from MCS: ref #1181981
2019-01-16 03:36:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 03:36:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1181981  12 58499 12995001 A  ERRORB¢ff'
2019-01-16 03:36:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 03:36:40 [DEBUG   ] Got command BAM from MCS: ref #1181986
2019-01-16 03:36:40 [INFO    ] Finished processing BAM request
2019-01-16 03:36:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:36:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181986   8 58499 13000033 A  ERROR'
2019-01-16 03:36:40 [DEBUG   ] Got command BAM from MCS: ref #1181985
2019-01-16 03:36:40 [INFO    ] Finished processing BAM request
2019-01-16 03:36:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:36:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181985   8 58499 13000037 A  ERROR'
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 03:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 03:36:40 [DEBUG   ] spawn_process: at 2019-01-16 03:36:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 03:36:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 03:36:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 03:36:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:37:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 03:37:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:37:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:37:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:37:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:37:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:37:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:37:00 [DEBUG   ] Finished updating board flags in 1.199 seconds
2019-01-16 03:37:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 03:37:22 [DEBUG   ] Got command BAM from MCS: ref #1181988
2019-01-16 03:37:22 [INFO    ] Finished processing BAM request
2019-01-16 03:37:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:37:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181988   8 58499 13042025 A  ERROR'
2019-01-16 03:37:22 [DEBUG   ] Got command BAM from MCS: ref #1181987
2019-01-16 03:37:22 [INFO    ] Finished processing BAM request
2019-01-16 03:37:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:37:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181987   8 58499 13042029 A  ERROR'
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 03:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 03:37:22 [DEBUG   ] spawn_process: at 2019-01-16 03:37:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 03:37:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 03:37:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 03:37:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 03:37:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 03:37:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-01-16 03:37:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:38:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:38:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:38:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:38:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:38:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:38:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:38:00 [DEBUG   ] Finished updating board flags in 1.013 seconds
2019-01-16 03:38:04 [DEBUG   ] Got command BAM from MCS: ref #1181990
2019-01-16 03:38:04 [INFO    ] Finished processing BAM request
2019-01-16 03:38:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:38:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181990   8 58499 13084033 A  ERROR'
2019-01-16 03:38:04 [DEBUG   ] Got command BAM from MCS: ref #1181989
2019-01-16 03:38:04 [INFO    ] Finished processing BAM request
2019-01-16 03:38:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:38:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181989   8 58499 13084037 A  ERROR'
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 03:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 03:38:04 [DEBUG   ] spawn_process: at 2019-01-16 03:38:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 03:38:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 03:38:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 03:38:46 [DEBUG   ] Got command BAM from MCS: ref #1181996
2019-01-16 03:38:46 [INFO    ] Finished processing BAM request
2019-01-16 03:38:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:38:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181996   8 58499 13126025 A  ERROR'
2019-01-16 03:38:46 [DEBUG   ] Got command BAM from MCS: ref #1181995
2019-01-16 03:38:46 [INFO    ] Finished processing BAM request
2019-01-16 03:38:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:38:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181995   8 58499 13126029 A  ERROR'
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 03:38:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 03:38:46 [DEBUG   ] spawn_process: at 2019-01-16 03:38:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 03:38:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 03:38:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-16 03:38:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-16 03:38:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:38:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 03:39:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 03:39:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:39:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:39:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:39:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:39:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:39:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:39:00 [DEBUG   ] Finished updating board flags in 1.069 seconds
2019-01-16 03:39:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 03:39:28 [DEBUG   ] Got command BAM from MCS: ref #1181998
2019-01-16 03:39:28 [INFO    ] Finished processing BAM request
2019-01-16 03:39:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:39:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181998   8 58499 13168033 A  ERROR'
2019-01-16 03:39:28 [DEBUG   ] Got command BAM from MCS: ref #1181997
2019-01-16 03:39:28 [INFO    ] Finished processing BAM request
2019-01-16 03:39:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:39:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181997   8 58499 13168037 A  ERROR'
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 03:39:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 03:39:28 [DEBUG   ] spawn_process: at 2019-01-16 03:39:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 03:39:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 03:39:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 03:40:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 03:40:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:40:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:40:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:40:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:40:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:40:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:40:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:40:01 [DEBUG   ] Finished updating board flags in 2.032 seconds
2019-01-16 03:40:09 [DEBUG   ] Got command BAM from MCS: ref #1182000
2019-01-16 03:40:09 [INFO    ] Finished processing BAM request
2019-01-16 03:40:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:40:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182000   8 58499 13209033 A  ERROR'
2019-01-16 03:40:09 [DEBUG   ] Got command BAM from MCS: ref #1181999
2019-01-16 03:40:09 [INFO    ] Finished processing BAM request
2019-01-16 03:40:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:40:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1181999   8 58499 13209037 A  ERROR'
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 03:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 03:40:09 [DEBUG   ] spawn_process: at 2019-01-16 03:40:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 03:40:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 03:40:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 03:40:50 [DEBUG   ] Got command BAM from MCS: ref #1182001
2019-01-16 03:40:50 [INFO    ] Finished processing BAM request
2019-01-16 03:40:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:40:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182001   8 58499 13250029 A  ERROR'
2019-01-16 03:40:50 [DEBUG   ] Got command BAM from MCS: ref #1182002
2019-01-16 03:40:50 [INFO    ] Finished processing BAM request
2019-01-16 03:40:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:40:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182002   8 58499 13250033 A  ERROR'
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 03:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 03:40:50 [DEBUG   ] spawn_process: at 2019-01-16 03:40:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 03:40:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 03:41:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-16 03:41:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:41:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 03:41:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:41:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:41:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:41:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:41:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:41:00 [DEBUG   ] Finished updating board flags in 1.343 seconds
2019-01-16 03:41:05 [DEBUG   ] Got command RPT from MCS: ref #1182003
2019-01-16 03:41:05 [DEBUG   ] summary = ERROR
2019-01-16 03:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182003  13 58499 13265201 A  ERRORERROR'
2019-01-16 03:41:05 [DEBUG   ] Got command RPT from MCS: ref #1182004
2019-01-16 03:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182004  77 58499 13265202 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:41:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 03:41:31 [DEBUG   ] Got command BAM from MCS: ref #1182020
2019-01-16 03:41:31 [INFO    ] Finished processing BAM request
2019-01-16 03:41:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:41:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182020   8 58499 13291033 A  ERROR'
2019-01-16 03:41:31 [DEBUG   ] Got command BAM from MCS: ref #1182021
2019-01-16 03:41:31 [INFO    ] Finished processing BAM request
2019-01-16 03:41:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:41:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182021   8 58499 13291037 A  ERROR'
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 03:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 03:41:31 [DEBUG   ] spawn_process: at 2019-01-16 03:41:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 03:41:34 [DEBUG   ] Got command RPT from MCS: ref #1182022
2019-01-16 03:41:34 [DEBUG   ] summary = ERROR
2019-01-16 03:41:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182022  13 58499 13294289 A  ERRORERROR'
2019-01-16 03:41:34 [DEBUG   ] Got command RPT from MCS: ref #1182023
2019-01-16 03:41:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:41:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182023  77 58499 13294493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:41:34 [DEBUG   ] Got command RPT from MCS: ref #1182024
2019-01-16 03:41:34 [DEBUG   ] summary = ERROR
2019-01-16 03:41:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182024  13 58499 13294697 A  ERRORERROR'
2019-01-16 03:41:34 [DEBUG   ] Got command RPT from MCS: ref #1182025
2019-01-16 03:41:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:41:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182025  77 58499 13294889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:41:35 [DEBUG   ] Got command RPT from MCS: ref #1182026
2019-01-16 03:41:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 03:41:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182026  12 58499 13295093 A  ERRORB£ff'
2019-01-16 03:41:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 03:41:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 03:42:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:42:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:42:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:42:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:42:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:42:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:42:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:42:01 [DEBUG   ] Finished updating board flags in 1.759 seconds
2019-01-16 03:42:12 [DEBUG   ] Got command BAM from MCS: ref #1182031
2019-01-16 03:42:12 [INFO    ] Finished processing BAM request
2019-01-16 03:42:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:42:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182031   8 58499 13332029 A  ERROR'
2019-01-16 03:42:12 [DEBUG   ] Got command BAM from MCS: ref #1182032
2019-01-16 03:42:12 [INFO    ] Finished processing BAM request
2019-01-16 03:42:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:42:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182032   8 58499 13332033 A  ERROR'
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 03:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 03:42:12 [DEBUG   ] spawn_process: at 2019-01-16 03:42:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 03:42:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 03:42:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 03:42:53 [DEBUG   ] Got command BAM from MCS: ref #1182033
2019-01-16 03:42:53 [INFO    ] Finished processing BAM request
2019-01-16 03:42:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:42:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182033   8 58499 13373029 A  ERROR'
2019-01-16 03:42:53 [DEBUG   ] Got command BAM from MCS: ref #1182034
2019-01-16 03:42:53 [INFO    ] Finished processing BAM request
2019-01-16 03:42:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:42:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182034   8 58499 13373033 A  ERROR'
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 03:42:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 03:42:53 [DEBUG   ] spawn_process: at 2019-01-16 03:42:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 03:42:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 03:43:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 03:43:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:43:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 03:43:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 03:43:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:43:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:43:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:43:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:43:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:43:00 [DEBUG   ] Finished updating board flags in 1.042 seconds
2019-01-16 03:43:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 03:43:34 [DEBUG   ] Got command BAM from MCS: ref #1182035
2019-01-16 03:43:34 [INFO    ] Finished processing BAM request
2019-01-16 03:43:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182035   8 58499 13414033 A  ERROR'
2019-01-16 03:43:34 [DEBUG   ] Got command BAM from MCS: ref #1182036
2019-01-16 03:43:34 [INFO    ] Finished processing BAM request
2019-01-16 03:43:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182036   8 58499 13414037 A  ERROR'
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 03:43:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 03:43:34 [DEBUG   ] spawn_process: at 2019-01-16 03:43:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 03:43:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 03:43:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 03:44:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:44:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-16 03:44:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:44:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 03:44:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:44:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:44:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:44:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:44:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:44:00 [DEBUG   ] Finished updating board flags in 1.012 seconds
2019-01-16 03:44:15 [DEBUG   ] Got command BAM from MCS: ref #1182038
2019-01-16 03:44:15 [INFO    ] Finished processing BAM request
2019-01-16 03:44:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:44:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182038   8 58499 13455029 A  ERROR'
2019-01-16 03:44:15 [DEBUG   ] Got command BAM from MCS: ref #1182037
2019-01-16 03:44:15 [INFO    ] Finished processing BAM request
2019-01-16 03:44:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:44:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182037   8 58499 13455033 A  ERROR'
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 03:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 03:44:15 [DEBUG   ] spawn_process: at 2019-01-16 03:44:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 03:44:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 03:44:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 03:44:56 [DEBUG   ] Got command BAM from MCS: ref #1182044
2019-01-16 03:44:56 [INFO    ] Finished processing BAM request
2019-01-16 03:44:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:44:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182044   8 58499 13496029 A  ERROR'
2019-01-16 03:44:56 [DEBUG   ] Got command BAM from MCS: ref #1182043
2019-01-16 03:44:56 [INFO    ] Finished processing BAM request
2019-01-16 03:44:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:44:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182043   8 58499 13496033 A  ERROR'
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 03:44:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 03:44:56 [DEBUG   ] spawn_process: at 2019-01-16 03:44:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 03:44:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 03:45:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 03:45:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:45:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 03:45:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 03:45:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:45:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:45:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:45:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:45:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:45:00 [DEBUG   ] Finished updating board flags in 1.016 seconds
2019-01-16 03:45:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 03:45:37 [DEBUG   ] Got command BAM from MCS: ref #1182045
2019-01-16 03:45:37 [INFO    ] Finished processing BAM request
2019-01-16 03:45:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182045   8 58499 13537033 A  ERROR'
2019-01-16 03:45:37 [DEBUG   ] Got command BAM from MCS: ref #1182046
2019-01-16 03:45:37 [INFO    ] Finished processing BAM request
2019-01-16 03:45:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182046   8 58499 13537037 A  ERROR'
2019-01-16 03:45:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 03:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 03:45:37 [DEBUG   ] spawn_process: at 2019-01-16 03:45:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 03:45:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 03:46:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 03:46:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-16 03:46:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 03:46:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-16 03:46:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:46:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 03:46:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:46:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:46:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:46:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:46:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:46:01 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-01-16 03:46:05 [DEBUG   ] Got command RPT from MCS: ref #1182047
2019-01-16 03:46:05 [DEBUG   ] summary = ERROR
2019-01-16 03:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182047  13 58499 13565201 A  ERRORERROR'
2019-01-16 03:46:05 [DEBUG   ] Got command RPT from MCS: ref #1182048
2019-01-16 03:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182048  77 58499 13565202 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:46:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 03:46:18 [DEBUG   ] Got command BAM from MCS: ref #1182065
2019-01-16 03:46:18 [INFO    ] Finished processing BAM request
2019-01-16 03:46:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:46:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182065   8 58499 13578033 A  ERROR'
2019-01-16 03:46:18 [DEBUG   ] Got command BAM from MCS: ref #1182064
2019-01-16 03:46:18 [INFO    ] Finished processing BAM request
2019-01-16 03:46:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:46:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182064   8 58499 13578037 A  ERROR'
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 03:46:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 03:46:18 [DEBUG   ] spawn_process: at 2019-01-16 03:46:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 03:46:34 [DEBUG   ] Got command RPT from MCS: ref #1182068
2019-01-16 03:46:34 [DEBUG   ] summary = ERROR
2019-01-16 03:46:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182068  13 58499 13594381 A  ERRORERROR'
2019-01-16 03:46:34 [DEBUG   ] Got command RPT from MCS: ref #1182069
2019-01-16 03:46:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:46:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182069  77 58499 13594573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:46:34 [DEBUG   ] Got command RPT from MCS: ref #1182070
2019-01-16 03:46:34 [DEBUG   ] summary = ERROR
2019-01-16 03:46:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182070  13 58499 13594777 A  ERRORERROR'
2019-01-16 03:46:34 [DEBUG   ] Got command RPT from MCS: ref #1182072
2019-01-16 03:46:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:46:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182072  77 58499 13594981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:46:35 [DEBUG   ] Got command RPT from MCS: ref #1182074
2019-01-16 03:46:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 03:46:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182074  12 58499 13595185 A  ERRORB£ff'
2019-01-16 03:46:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 03:46:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 03:46:59 [DEBUG   ] Got command BAM from MCS: ref #1182078
2019-01-16 03:46:59 [INFO    ] Finished processing BAM request
2019-01-16 03:46:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:46:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182078   8 58499 13619025 A  ERROR'
2019-01-16 03:46:59 [DEBUG   ] Got command BAM from MCS: ref #1182079
2019-01-16 03:46:59 [INFO    ] Finished processing BAM request
2019-01-16 03:46:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:46:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182079   8 58499 13619029 A  ERROR'
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 03:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 03:46:59 [DEBUG   ] spawn_process: at 2019-01-16 03:46:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 03:47:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 03:47:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 03:47:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:47:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 03:47:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:47:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:47:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:47:00 [WARNING ] (13, 1, 'bot')
2019-01-16 03:47:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:47:00 [DEBUG   ] Finished updating board flags in 0.959 seconds
2019-01-16 03:47:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 03:47:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 03:47:40 [DEBUG   ] Got command BAM from MCS: ref #1182080
2019-01-16 03:47:40 [INFO    ] Finished processing BAM request
2019-01-16 03:47:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182080   8 58499 13660029 A  ERROR'
2019-01-16 03:47:40 [DEBUG   ] Got command BAM from MCS: ref #1182081
2019-01-16 03:47:40 [INFO    ] Finished processing BAM request
2019-01-16 03:47:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182081   8 58499 13660033 A  ERROR'
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 03:47:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 03:47:40 [DEBUG   ] spawn_process: at 2019-01-16 03:47:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 03:47:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 03:48:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:48:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 03:48:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:48:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:48:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:48:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:48:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:48:01 [DEBUG   ] Finished updating board flags in 1.377 seconds
2019-01-16 03:48:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 03:48:21 [DEBUG   ] Got command BAM from MCS: ref #1182086
2019-01-16 03:48:21 [INFO    ] Finished processing BAM request
2019-01-16 03:48:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182086   8 58499 13701025 A  ERROR'
2019-01-16 03:48:21 [DEBUG   ] Got command BAM from MCS: ref #1182087
2019-01-16 03:48:21 [INFO    ] Finished processing BAM request
2019-01-16 03:48:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182087   8 58499 13701029 A  ERROR'
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 03:48:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 03:48:21 [DEBUG   ] spawn_process: at 2019-01-16 03:48:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 03:48:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 03:48:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 03:49:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 03:49:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:49:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 03:49:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 03:49:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:49:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:49:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:49:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:49:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:49:01 [DEBUG   ] Finished updating board flags in 1.208 seconds
2019-01-16 03:49:02 [DEBUG   ] Got command BAM from MCS: ref #1182089
2019-01-16 03:49:02 [INFO    ] Finished processing BAM request
2019-01-16 03:49:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:49:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182089   8 58499 13742033 A  ERROR'
2019-01-16 03:49:02 [DEBUG   ] Got command BAM from MCS: ref #1182088
2019-01-16 03:49:02 [INFO    ] Finished processing BAM request
2019-01-16 03:49:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:49:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182088   8 58499 13742037 A  ERROR'
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 03:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 03:49:02 [DEBUG   ] spawn_process: at 2019-01-16 03:49:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 03:49:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 03:49:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 03:49:43 [DEBUG   ] Got command BAM from MCS: ref #1182091
2019-01-16 03:49:43 [INFO    ] Finished processing BAM request
2019-01-16 03:49:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:49:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182091   8 58499 13783033 A  ERROR'
2019-01-16 03:49:43 [DEBUG   ] Got command BAM from MCS: ref #1182090
2019-01-16 03:49:43 [INFO    ] Finished processing BAM request
2019-01-16 03:49:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:49:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182090   8 58499 13783037 A  ERROR'
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 03:49:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 03:49:43 [DEBUG   ] spawn_process: at 2019-01-16 03:49:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 03:49:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 03:50:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 03:50:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:50:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 03:50:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 03:50:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:50:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:50:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:50:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:50:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:50:01 [DEBUG   ] Finished updating board flags in 1.184 seconds
2019-01-16 03:50:17 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-16 03:50:24 [DEBUG   ] Got command BAM from MCS: ref #1182092
2019-01-16 03:50:24 [INFO    ] Finished processing BAM request
2019-01-16 03:50:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:50:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182092   8 58499 13824030 A  ERROR'
2019-01-16 03:50:24 [DEBUG   ] Got command BAM from MCS: ref #1182093
2019-01-16 03:50:24 [INFO    ] Finished processing BAM request
2019-01-16 03:50:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:50:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182093   8 58499 13824034 A  ERROR'
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 03:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 03:50:24 [DEBUG   ] spawn_process: at 2019-01-16 03:50:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 03:50:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 03:50:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 03:51:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 03:51:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:51:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 03:51:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:51:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:51:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:51:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:51:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:51:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:51:01 [DEBUG   ] Finished updating board flags in 0.998 seconds
2019-01-16 03:51:05 [DEBUG   ] Got command BAM from MCS: ref #1182098
2019-01-16 03:51:05 [INFO    ] Finished processing BAM request
2019-01-16 03:51:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182098   8 58499 13865030 A  ERROR'
2019-01-16 03:51:05 [DEBUG   ] Got command BAM from MCS: ref #1182099
2019-01-16 03:51:05 [INFO    ] Finished processing BAM request
2019-01-16 03:51:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182099   8 58499 13865034 A  ERROR'
2019-01-16 03:51:05 [DEBUG   ] Got command RPT from MCS: ref #1182100
2019-01-16 03:51:05 [DEBUG   ] summary = ERROR
2019-01-16 03:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182100  13 58499 13865201 A  ERRORERROR'
2019-01-16 03:51:05 [DEBUG   ] Got command RPT from MCS: ref #1182101
2019-01-16 03:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182101  77 58499 13865202 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 03:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 03:51:05 [DEBUG   ] spawn_process: at 2019-01-16 03:51:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 03:51:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 03:51:34 [DEBUG   ] Got command RPT from MCS: ref #1182117
2019-01-16 03:51:34 [DEBUG   ] summary = ERROR
2019-01-16 03:51:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182117  13 58499 13894458 A  ERRORERROR'
2019-01-16 03:51:34 [DEBUG   ] Got command RPT from MCS: ref #1182118
2019-01-16 03:51:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:51:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182118  77 58499 13894661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:51:34 [DEBUG   ] Got command RPT from MCS: ref #1182119
2019-01-16 03:51:34 [DEBUG   ] summary = ERROR
2019-01-16 03:51:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182119  13 58499 13894866 A  ERRORERROR'
2019-01-16 03:51:35 [DEBUG   ] Got command RPT from MCS: ref #1182120
2019-01-16 03:51:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:51:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182120  77 58499 13895074 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:51:35 [DEBUG   ] Got command RPT from MCS: ref #1182121
2019-01-16 03:51:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 03:51:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182121  12 58499 13895266 A  ERRORB¢ff'
2019-01-16 03:51:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 03:51:46 [DEBUG   ] Got command BAM from MCS: ref #1182122
2019-01-16 03:51:46 [INFO    ] Finished processing BAM request
2019-01-16 03:51:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:51:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182122   8 58499 13906034 A  ERROR'
2019-01-16 03:51:46 [DEBUG   ] Got command BAM from MCS: ref #1182123
2019-01-16 03:51:46 [INFO    ] Finished processing BAM request
2019-01-16 03:51:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:51:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182123   8 58499 13906038 A  ERROR'
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 03:51:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 03:51:46 [DEBUG   ] spawn_process: at 2019-01-16 03:51:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 03:51:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 03:52:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:52:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:52:02 [WARNING ] (13, 1, 'bot')
2019-01-16 03:52:02 [WARNING ] (13, 1, 'bot')
2019-01-16 03:52:02 [WARNING ] (13, 1, 'bot')
2019-01-16 03:52:02 [WARNING ] (13, 1, 'bot')
2019-01-16 03:52:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:52:02 [DEBUG   ] Finished updating board flags in 1.800 seconds
2019-01-16 03:52:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 03:52:27 [DEBUG   ] Got command BAM from MCS: ref #1182124
2019-01-16 03:52:27 [INFO    ] Finished processing BAM request
2019-01-16 03:52:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:52:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182124   8 58499 13947025 A  ERROR'
2019-01-16 03:52:27 [DEBUG   ] Got command BAM from MCS: ref #1182125
2019-01-16 03:52:27 [INFO    ] Finished processing BAM request
2019-01-16 03:52:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:52:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182125   8 58499 13947029 A  ERROR'
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 03:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 03:52:27 [DEBUG   ] spawn_process: at 2019-01-16 03:52:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 03:52:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 03:52:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 03:53:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 03:53:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:53:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:53:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:53:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:53:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:53:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:53:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:53:01 [DEBUG   ] Finished updating board flags in 1.272 seconds
2019-01-16 03:53:08 [DEBUG   ] Got command BAM from MCS: ref #1182127
2019-01-16 03:53:08 [INFO    ] Finished processing BAM request
2019-01-16 03:53:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:53:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182127   8 58499 13988033 A  ERROR'
2019-01-16 03:53:08 [DEBUG   ] Got command BAM from MCS: ref #1182126
2019-01-16 03:53:08 [INFO    ] Finished processing BAM request
2019-01-16 03:53:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:53:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182126   8 58499 13988037 A  ERROR'
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 03:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 03:53:08 [DEBUG   ] spawn_process: at 2019-01-16 03:53:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 03:53:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 03:53:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 03:53:49 [DEBUG   ] Got command BAM from MCS: ref #1182133
2019-01-16 03:53:49 [INFO    ] Finished processing BAM request
2019-01-16 03:53:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:53:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182133   8 58499 14029025 A  ERROR'
2019-01-16 03:53:49 [DEBUG   ] Got command BAM from MCS: ref #1182132
2019-01-16 03:53:49 [INFO    ] Finished processing BAM request
2019-01-16 03:53:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:53:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182132   8 58499 14029029 A  ERROR'
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 03:53:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 03:53:49 [DEBUG   ] spawn_process: at 2019-01-16 03:53:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 03:53:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 03:54:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:54:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 03:54:02 [WARNING ] (13, 1, 'bot')
2019-01-16 03:54:02 [WARNING ] (13, 1, 'bot')
2019-01-16 03:54:02 [WARNING ] (13, 1, 'bot')
2019-01-16 03:54:02 [WARNING ] (13, 1, 'bot')
2019-01-16 03:54:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:54:02 [DEBUG   ] Finished updating board flags in 1.821 seconds
2019-01-16 03:54:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 03:54:30 [DEBUG   ] Got command BAM from MCS: ref #1182135
2019-01-16 03:54:30 [INFO    ] Finished processing BAM request
2019-01-16 03:54:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:54:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182135   8 58499 14070029 A  ERROR'
2019-01-16 03:54:30 [DEBUG   ] Got command BAM from MCS: ref #1182134
2019-01-16 03:54:30 [INFO    ] Finished processing BAM request
2019-01-16 03:54:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:54:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182134   8 58499 14070033 A  ERROR'
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 03:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 03:54:30 [DEBUG   ] spawn_process: at 2019-01-16 03:54:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 03:54:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 03:54:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 03:55:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:55:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 03:55:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 03:55:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:55:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:55:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:55:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:55:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:55:01 [DEBUG   ] Finished updating board flags in 1.179 seconds
2019-01-16 03:55:11 [DEBUG   ] Got command BAM from MCS: ref #1182136
2019-01-16 03:55:11 [INFO    ] Finished processing BAM request
2019-01-16 03:55:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:55:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182136   8 58499 14111033 A  ERROR'
2019-01-16 03:55:11 [DEBUG   ] Got command BAM from MCS: ref #1182137
2019-01-16 03:55:11 [INFO    ] Finished processing BAM request
2019-01-16 03:55:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:55:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182137   8 58499 14111037 A  ERROR'
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 03:55:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 03:55:11 [DEBUG   ] spawn_process: at 2019-01-16 03:55:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 03:55:17 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-16 03:55:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 03:55:52 [DEBUG   ] Got command BAM from MCS: ref #1182138
2019-01-16 03:55:52 [INFO    ] Finished processing BAM request
2019-01-16 03:55:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:55:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182138   8 58499 14152025 A  ERROR'
2019-01-16 03:55:52 [DEBUG   ] Got command BAM from MCS: ref #1182139
2019-01-16 03:55:52 [INFO    ] Finished processing BAM request
2019-01-16 03:55:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:55:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182139   8 58499 14152029 A  ERROR'
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 03:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 03:55:52 [DEBUG   ] spawn_process: at 2019-01-16 03:55:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 03:55:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 03:56:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 03:56:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2019-01-16 03:56:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:56:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 03:56:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 03:56:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:56:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:56:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:56:01 [WARNING ] (13, 1, 'bot')
2019-01-16 03:56:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:56:01 [DEBUG   ] Finished updating board flags in 1.003 seconds
2019-01-16 03:56:05 [DEBUG   ] Got command RPT from MCS: ref #1182140
2019-01-16 03:56:05 [DEBUG   ] summary = ERROR
2019-01-16 03:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182140  13 58499 14165201 A  ERRORERROR'
2019-01-16 03:56:05 [DEBUG   ] Got command RPT from MCS: ref #1182141
2019-01-16 03:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182141  77 58499 14165202 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:56:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 03:56:33 [DEBUG   ] Got command BAM from MCS: ref #1182159
2019-01-16 03:56:33 [INFO    ] Finished processing BAM request
2019-01-16 03:56:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:56:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182159   8 58499 14193033 A  ERROR'
2019-01-16 03:56:33 [DEBUG   ] Got command BAM from MCS: ref #1182160
2019-01-16 03:56:33 [INFO    ] Finished processing BAM request
2019-01-16 03:56:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:56:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182160   8 58499 14193037 A  ERROR'
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 03:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 03:56:33 [DEBUG   ] spawn_process: at 2019-01-16 03:56:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 03:56:34 [DEBUG   ] Got command RPT from MCS: ref #1182161
2019-01-16 03:56:34 [DEBUG   ] summary = ERROR
2019-01-16 03:56:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182161  13 58499 14194549 A  ERRORERROR'
2019-01-16 03:56:34 [DEBUG   ] Got command RPT from MCS: ref #1182162
2019-01-16 03:56:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:56:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182162  77 58499 14194741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:56:34 [DEBUG   ] Got command RPT from MCS: ref #1182163
2019-01-16 03:56:34 [DEBUG   ] summary = ERROR
2019-01-16 03:56:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182163  13 58499 14194945 A  ERRORERROR'
2019-01-16 03:56:35 [DEBUG   ] Got command RPT from MCS: ref #1182164
2019-01-16 03:56:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 03:56:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182164  77 58499 14195149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 03:56:35 [DEBUG   ] Got command RPT from MCS: ref #1182166
2019-01-16 03:56:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 03:56:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182166  12 58499 14195353 A  ERRORB£ff'
2019-01-16 03:56:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 03:56:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 03:57:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 03:57:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-16 03:57:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 03:57:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:57:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 03:57:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 03:57:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 03:57:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 03:57:02 [WARNING ] (13, 1, 'bot')
2019-01-16 03:57:02 [WARNING ] (13, 1, 'bot')
2019-01-16 03:57:02 [WARNING ] (13, 1, 'bot')
2019-01-16 03:57:02 [WARNING ] (13, 1, 'bot')
2019-01-16 03:57:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:57:02 [DEBUG   ] Finished updating board flags in 1.546 seconds
2019-01-16 03:57:14 [DEBUG   ] Got command BAM from MCS: ref #1182175
2019-01-16 03:57:14 [INFO    ] Finished processing BAM request
2019-01-16 03:57:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:57:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182175   8 58499 14234033 A  ERROR'
2019-01-16 03:57:14 [DEBUG   ] Got command BAM from MCS: ref #1182176
2019-01-16 03:57:14 [INFO    ] Finished processing BAM request
2019-01-16 03:57:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:57:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182176   8 58499 14234037 A  ERROR'
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 03:57:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 03:57:14 [DEBUG   ] spawn_process: at 2019-01-16 03:57:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 03:57:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 03:57:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-16 03:57:55 [DEBUG   ] Got command BAM from MCS: ref #1182178
2019-01-16 03:57:55 [INFO    ] Finished processing BAM request
2019-01-16 03:57:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:57:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182178   8 58499 14275029 A  ERROR'
2019-01-16 03:57:55 [DEBUG   ] Got command BAM from MCS: ref #1182177
2019-01-16 03:57:55 [INFO    ] Finished processing BAM request
2019-01-16 03:57:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:57:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182177   8 58499 14275033 A  ERROR'
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 03:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 03:57:55 [DEBUG   ] spawn_process: at 2019-01-16 03:57:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 03:57:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 03:58:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:58:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 03:58:02 [WARNING ] (13, 1, 'bot')
2019-01-16 03:58:02 [WARNING ] (13, 1, 'bot')
2019-01-16 03:58:02 [WARNING ] (13, 1, 'bot')
2019-01-16 03:58:02 [WARNING ] (13, 1, 'bot')
2019-01-16 03:58:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:58:02 [DEBUG   ] Finished updating board flags in 1.398 seconds
2019-01-16 03:58:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 03:58:36 [DEBUG   ] Got command BAM from MCS: ref #1182179
2019-01-16 03:58:36 [INFO    ] Finished processing BAM request
2019-01-16 03:58:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:58:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182179   8 58499 14316029 A  ERROR'
2019-01-16 03:58:36 [DEBUG   ] Got command BAM from MCS: ref #1182180
2019-01-16 03:58:36 [INFO    ] Finished processing BAM request
2019-01-16 03:58:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:58:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182180   8 58499 14316033 A  ERROR'
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 03:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 03:58:36 [DEBUG   ] spawn_process: at 2019-01-16 03:58:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 03:58:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 03:58:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 03:59:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-16 03:59:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 03:59:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 03:59:02 [WARNING ] (13, 1, 'bot')
2019-01-16 03:59:02 [WARNING ] (13, 1, 'bot')
2019-01-16 03:59:02 [WARNING ] (13, 1, 'bot')
2019-01-16 03:59:02 [WARNING ] (13, 1, 'bot')
2019-01-16 03:59:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 03:59:02 [DEBUG   ] Finished updating board flags in 1.203 seconds
2019-01-16 03:59:17 [DEBUG   ] Got command BAM from MCS: ref #1182181
2019-01-16 03:59:17 [INFO    ] Finished processing BAM request
2019-01-16 03:59:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:59:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182181   8 58499 14357033 A  ERROR'
2019-01-16 03:59:17 [DEBUG   ] Got command BAM from MCS: ref #1182182
2019-01-16 03:59:17 [INFO    ] Finished processing BAM request
2019-01-16 03:59:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:59:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182182   8 58499 14357037 A  ERROR'
2019-01-16 03:59:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 03:59:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 03:59:17 [DEBUG   ] spawn_process: at 2019-01-16 03:59:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 03:59:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 03:59:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 03:59:58 [DEBUG   ] Got command BAM from MCS: ref #1182187
2019-01-16 03:59:58 [INFO    ] Finished processing BAM request
2019-01-16 03:59:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182187   8 58499 14398033 A  ERROR'
2019-01-16 03:59:58 [DEBUG   ] Got command BAM from MCS: ref #1182188
2019-01-16 03:59:58 [INFO    ] Finished processing BAM request
2019-01-16 03:59:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 03:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182188   8 58499 14398037 A  ERROR'
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 03:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 03:59:58 [DEBUG   ] spawn_process: at 2019-01-16 03:59:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 04:00:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-16 04:00:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 04:00:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:00:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-01-16 04:00:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:00:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 04:00:02 [WARNING ] (13, 1, 'bot')
2019-01-16 04:00:02 [WARNING ] (13, 1, 'bot')
2019-01-16 04:00:02 [WARNING ] (13, 1, 'bot')
2019-01-16 04:00:02 [WARNING ] (13, 1, 'bot')
2019-01-16 04:00:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:00:02 [DEBUG   ] Finished updating board flags in 1.193 seconds
2019-01-16 04:00:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:00:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 04:00:39 [DEBUG   ] Got command BAM from MCS: ref #1182189
2019-01-16 04:00:39 [INFO    ] Finished processing BAM request
2019-01-16 04:00:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182189   8 58499 14439029 A  ERROR'
2019-01-16 04:00:39 [DEBUG   ] Got command BAM from MCS: ref #1182190
2019-01-16 04:00:39 [INFO    ] Finished processing BAM request
2019-01-16 04:00:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182190   8 58499 14439033 A  ERROR'
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 04:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 04:00:39 [DEBUG   ] spawn_process: at 2019-01-16 04:00:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 04:00:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:01:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 04:01:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-16 04:01:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 04:01:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:01:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:01:02 [WARNING ] (13, 1, 'bot')
2019-01-16 04:01:02 [WARNING ] (13, 1, 'bot')
2019-01-16 04:01:02 [WARNING ] (13, 1, 'bot')
2019-01-16 04:01:02 [WARNING ] (13, 1, 'bot')
2019-01-16 04:01:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:01:02 [DEBUG   ] Finished updating board flags in 1.077 seconds
2019-01-16 04:01:05 [DEBUG   ] Got command RPT from MCS: ref #1182191
2019-01-16 04:01:05 [DEBUG   ] summary = ERROR
2019-01-16 04:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182191  13 58499 14465201 A  ERRORERROR'
2019-01-16 04:01:05 [DEBUG   ] Got command RPT from MCS: ref #1182192
2019-01-16 04:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182192  77 58499 14465202 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:01:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:01:20 [DEBUG   ] Got command BAM from MCS: ref #1182208
2019-01-16 04:01:20 [INFO    ] Finished processing BAM request
2019-01-16 04:01:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:01:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182208   8 58499 14480025 A  ERROR'
2019-01-16 04:01:20 [DEBUG   ] Got command BAM from MCS: ref #1182209
2019-01-16 04:01:20 [INFO    ] Finished processing BAM request
2019-01-16 04:01:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:01:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182209   8 58499 14480029 A  ERROR'
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 04:01:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 04:01:20 [DEBUG   ] spawn_process: at 2019-01-16 04:01:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 04:01:34 [DEBUG   ] Got command RPT from MCS: ref #1182210
2019-01-16 04:01:34 [DEBUG   ] summary = ERROR
2019-01-16 04:01:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182210  13 58499 14494629 A  ERRORERROR'
2019-01-16 04:01:34 [DEBUG   ] Got command RPT from MCS: ref #1182211
2019-01-16 04:01:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:01:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182211  77 58499 14494833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:01:35 [DEBUG   ] Got command RPT from MCS: ref #1182212
2019-01-16 04:01:35 [DEBUG   ] summary = ERROR
2019-01-16 04:01:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182212  13 58499 14495037 A  ERRORERROR'
2019-01-16 04:01:35 [DEBUG   ] Got command RPT from MCS: ref #1182213
2019-01-16 04:01:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:01:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182213  77 58499 14495241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:01:35 [DEBUG   ] Got command RPT from MCS: ref #1182214
2019-01-16 04:01:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 04:01:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182214  12 58499 14495433 A  ERRORB£ff'
2019-01-16 04:01:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:01:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:02:00 [DEBUG   ] Got command BAM from MCS: ref #1182215
2019-01-16 04:02:00 [INFO    ] Finished processing BAM request
2019-01-16 04:02:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:02:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182215   8 58499 14520033 A  ERROR'
2019-01-16 04:02:00 [DEBUG   ] Got command BAM from MCS: ref #1182216
2019-01-16 04:02:00 [INFO    ] Finished processing BAM request
2019-01-16 04:02:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:02:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182216   8 58499 14520037 A  ERROR'
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 04:02:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 04:02:00 [DEBUG   ] spawn_process: at 2019-01-16 04:02:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 04:02:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 04:02:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:02:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:02:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 04:02:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:02:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:02:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:02:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:02:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:02:03 [DEBUG   ] Finished updating board flags in 1.997 seconds
2019-01-16 04:02:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:02:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:02:40 [DEBUG   ] Got command BAM from MCS: ref #1182218
2019-01-16 04:02:40 [INFO    ] Finished processing BAM request
2019-01-16 04:02:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182218   8 58499 14560029 A  ERROR'
2019-01-16 04:02:40 [DEBUG   ] Got command BAM from MCS: ref #1182217
2019-01-16 04:02:40 [INFO    ] Finished processing BAM request
2019-01-16 04:02:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182217   8 58499 14560033 A  ERROR'
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 04:02:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 04:02:40 [DEBUG   ] spawn_process: at 2019-01-16 04:02:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 04:02:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 04:03:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 04:03:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:03:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-16 04:03:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:03:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 04:03:02 [WARNING ] (13, 1, 'bot')
2019-01-16 04:03:02 [WARNING ] (13, 1, 'bot')
2019-01-16 04:03:02 [WARNING ] (13, 1, 'bot')
2019-01-16 04:03:02 [WARNING ] (13, 1, 'bot')
2019-01-16 04:03:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:03:02 [DEBUG   ] Finished updating board flags in 1.183 seconds
2019-01-16 04:03:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:03:20 [DEBUG   ] Got command BAM from MCS: ref #1182224
2019-01-16 04:03:20 [INFO    ] Finished processing BAM request
2019-01-16 04:03:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:03:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182224   8 58499 14600029 A  ERROR'
2019-01-16 04:03:20 [DEBUG   ] Got command BAM from MCS: ref #1182223
2019-01-16 04:03:20 [INFO    ] Finished processing BAM request
2019-01-16 04:03:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:03:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182223   8 58499 14600033 A  ERROR'
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 04:03:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 04:03:20 [DEBUG   ] spawn_process: at 2019-01-16 04:03:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 04:03:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 04:03:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:04:00 [DEBUG   ] Got command BAM from MCS: ref #1182226
2019-01-16 04:04:00 [INFO    ] Finished processing BAM request
2019-01-16 04:04:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:04:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182226   8 58499 14640034 A  ERROR'
2019-01-16 04:04:00 [DEBUG   ] Got command BAM from MCS: ref #1182225
2019-01-16 04:04:00 [INFO    ] Finished processing BAM request
2019-01-16 04:04:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:04:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182225   8 58499 14640038 A  ERROR'
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 04:04:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 04:04:00 [DEBUG   ] spawn_process: at 2019-01-16 04:04:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 04:04:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:04:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 04:04:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:04:02 [WARNING ] (13, 1, 'bot')
2019-01-16 04:04:02 [WARNING ] (13, 1, 'bot')
2019-01-16 04:04:02 [WARNING ] (13, 1, 'bot')
2019-01-16 04:04:02 [WARNING ] (13, 1, 'bot')
2019-01-16 04:04:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:04:02 [DEBUG   ] Finished updating board flags in 1.023 seconds
2019-01-16 04:04:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:04:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:04:40 [DEBUG   ] Got command BAM from MCS: ref #1182227
2019-01-16 04:04:40 [INFO    ] Finished processing BAM request
2019-01-16 04:04:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:04:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182227   8 58499 14680025 A  ERROR'
2019-01-16 04:04:40 [DEBUG   ] Got command BAM from MCS: ref #1182228
2019-01-16 04:04:40 [INFO    ] Finished processing BAM request
2019-01-16 04:04:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:04:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182228   8 58499 14680029 A  ERROR'
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 04:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 04:04:40 [DEBUG   ] spawn_process: at 2019-01-16 04:04:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 04:04:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 04:05:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 04:05:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-16 04:05:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:05:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-16 04:05:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:05:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 04:05:02 [WARNING ] (13, 1, 'bot')
2019-01-16 04:05:02 [WARNING ] (13, 1, 'bot')
2019-01-16 04:05:02 [WARNING ] (13, 1, 'bot')
2019-01-16 04:05:02 [WARNING ] (13, 1, 'bot')
2019-01-16 04:05:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:05:02 [DEBUG   ] Finished updating board flags in 0.979 seconds
2019-01-16 04:05:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:05:20 [DEBUG   ] Got command BAM from MCS: ref #1182229
2019-01-16 04:05:20 [INFO    ] Finished processing BAM request
2019-01-16 04:05:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:05:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182229   8 58499 14720025 A  ERROR'
2019-01-16 04:05:20 [DEBUG   ] Got command BAM from MCS: ref #1182230
2019-01-16 04:05:20 [INFO    ] Finished processing BAM request
2019-01-16 04:05:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:05:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182230   8 58499 14720029 A  ERROR'
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 04:05:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 04:05:20 [DEBUG   ] spawn_process: at 2019-01-16 04:05:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 04:05:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:05:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:06:00 [DEBUG   ] Got command BAM from MCS: ref #1182235
2019-01-16 04:06:00 [INFO    ] Finished processing BAM request
2019-01-16 04:06:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:06:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182235   8 58499 14760033 A  ERROR'
2019-01-16 04:06:00 [DEBUG   ] Got command BAM from MCS: ref #1182236
2019-01-16 04:06:00 [INFO    ] Finished processing BAM request
2019-01-16 04:06:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:06:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182236   8 58499 14760037 A  ERROR'
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 04:06:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 04:06:00 [DEBUG   ] spawn_process: at 2019-01-16 04:06:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 04:06:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-01-16 04:06:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 04:06:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:06:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 04:06:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:06:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-01-16 04:06:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:06:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:06:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:06:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:06:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:06:03 [DEBUG   ] Finished updating board flags in 1.363 seconds
2019-01-16 04:06:05 [DEBUG   ] Got command RPT from MCS: ref #1182237
2019-01-16 04:06:05 [DEBUG   ] summary = ERROR
2019-01-16 04:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182237  13 58499 14765205 A  ERRORERROR'
2019-01-16 04:06:05 [DEBUG   ] Got command RPT from MCS: ref #1182238
2019-01-16 04:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182238  77 58499 14765206 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:06:17 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2019-01-16 04:06:34 [DEBUG   ] Got command RPT from MCS: ref #1182256
2019-01-16 04:06:34 [DEBUG   ] summary = ERROR
2019-01-16 04:06:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182256  13 58499 14794713 A  ERRORERROR'
2019-01-16 04:06:34 [DEBUG   ] Got command RPT from MCS: ref #1182257
2019-01-16 04:06:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:06:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182257  77 58499 14794917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:06:35 [DEBUG   ] Got command RPT from MCS: ref #1182258
2019-01-16 04:06:35 [DEBUG   ] summary = ERROR
2019-01-16 04:06:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182258  13 58499 14795160 A  ERRORERROR'
2019-01-16 04:06:35 [DEBUG   ] Got command RPT from MCS: ref #1182260
2019-01-16 04:06:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:06:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182260  77 58499 14795325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:06:35 [DEBUG   ] Got command RPT from MCS: ref #1182261
2019-01-16 04:06:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 04:06:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182261  12 58499 14795517 A  ERRORB¢ff'
2019-01-16 04:06:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 04:06:40 [DEBUG   ] Got command BAM from MCS: ref #1182266
2019-01-16 04:06:40 [INFO    ] Finished processing BAM request
2019-01-16 04:06:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:06:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182266   8 58499 14800029 A  ERROR'
2019-01-16 04:06:40 [DEBUG   ] Got command BAM from MCS: ref #1182267
2019-01-16 04:06:40 [INFO    ] Finished processing BAM request
2019-01-16 04:06:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:06:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182267   8 58499 14800033 A  ERROR'
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 04:06:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 04:06:40 [DEBUG   ] spawn_process: at 2019-01-16 04:06:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 04:06:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 04:07:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 04:07:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:07:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:07:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:07:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:07:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:07:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:07:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:07:03 [DEBUG   ] Finished updating board flags in 1.195 seconds
2019-01-16 04:07:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 04:07:20 [DEBUG   ] Got command BAM from MCS: ref #1182269
2019-01-16 04:07:20 [INFO    ] Finished processing BAM request
2019-01-16 04:07:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:07:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182269   8 58499 14840025 A  ERROR'
2019-01-16 04:07:20 [DEBUG   ] Got command BAM from MCS: ref #1182268
2019-01-16 04:07:20 [INFO    ] Finished processing BAM request
2019-01-16 04:07:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:07:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182268   8 58499 14840029 A  ERROR'
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 04:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 04:07:20 [DEBUG   ] spawn_process: at 2019-01-16 04:07:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 04:07:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 04:07:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 04:08:00 [DEBUG   ] Got command BAM from MCS: ref #1182271
2019-01-16 04:08:00 [INFO    ] Finished processing BAM request
2019-01-16 04:08:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:08:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182271   8 58499 14880029 A  ERROR'
2019-01-16 04:08:00 [DEBUG   ] Got command BAM from MCS: ref #1182270
2019-01-16 04:08:00 [INFO    ] Finished processing BAM request
2019-01-16 04:08:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:08:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182270   8 58499 14880033 A  ERROR'
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 04:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 04:08:00 [DEBUG   ] spawn_process: at 2019-01-16 04:08:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 04:08:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 04:08:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:08:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:08:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:08:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:08:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:08:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:08:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:08:03 [DEBUG   ] Finished updating board flags in 1.002 seconds
2019-01-16 04:08:17 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-16 04:08:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 04:08:40 [DEBUG   ] Got command BAM from MCS: ref #1182272
2019-01-16 04:08:40 [INFO    ] Finished processing BAM request
2019-01-16 04:08:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:08:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182272   8 58499 14920033 A  ERROR'
2019-01-16 04:08:40 [DEBUG   ] Got command BAM from MCS: ref #1182273
2019-01-16 04:08:40 [INFO    ] Finished processing BAM request
2019-01-16 04:08:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:08:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182273   8 58499 14920037 A  ERROR'
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 04:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 04:08:40 [DEBUG   ] spawn_process: at 2019-01-16 04:08:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 04:08:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:09:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 04:09:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:09:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:09:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:09:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:09:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:09:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:09:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:09:03 [DEBUG   ] Finished updating board flags in 1.070 seconds
2019-01-16 04:09:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:09:20 [DEBUG   ] Got command BAM from MCS: ref #1182278
2019-01-16 04:09:20 [INFO    ] Finished processing BAM request
2019-01-16 04:09:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182278   8 58499 14960033 A  ERROR'
2019-01-16 04:09:20 [DEBUG   ] Got command BAM from MCS: ref #1182279
2019-01-16 04:09:20 [INFO    ] Finished processing BAM request
2019-01-16 04:09:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182279   8 58499 14960037 A  ERROR'
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 04:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 04:09:20 [DEBUG   ] spawn_process: at 2019-01-16 04:09:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 04:09:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:09:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:10:00 [DEBUG   ] Got command BAM from MCS: ref #1182280
2019-01-16 04:10:00 [INFO    ] Finished processing BAM request
2019-01-16 04:10:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:10:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182280   8 58499 15000025 A  ERROR'
2019-01-16 04:10:00 [DEBUG   ] Got command BAM from MCS: ref #1182281
2019-01-16 04:10:00 [INFO    ] Finished processing BAM request
2019-01-16 04:10:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:10:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182281   8 58499 15000029 A  ERROR'
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 04:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 04:10:00 [DEBUG   ] spawn_process: at 2019-01-16 04:10:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 04:10:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-16 04:10:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:10:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-16 04:10:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:10:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 04:10:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:10:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:10:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:10:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:10:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:10:04 [DEBUG   ] Finished updating board flags in 2.006 seconds
2019-01-16 04:10:18 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-01-16 04:10:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 04:10:40 [DEBUG   ] Got command BAM from MCS: ref #1182283
2019-01-16 04:10:40 [INFO    ] Finished processing BAM request
2019-01-16 04:10:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182283   8 58499 15040033 A  ERROR'
2019-01-16 04:10:40 [DEBUG   ] Got command BAM from MCS: ref #1182282
2019-01-16 04:10:40 [INFO    ] Finished processing BAM request
2019-01-16 04:10:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182282   8 58499 15040037 A  ERROR'
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 04:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 04:10:40 [DEBUG   ] spawn_process: at 2019-01-16 04:10:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 04:10:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 04:11:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 04:11:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 04:11:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:11:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 04:11:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2019-01-16 04:11:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-16 04:11:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-16 04:11:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:11:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:11:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:11:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:11:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:11:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:11:04 [DEBUG   ] Finished updating board flags in 1.935 seconds
2019-01-16 04:11:05 [DEBUG   ] Got command RPT from MCS: ref #1182284
2019-01-16 04:11:05 [DEBUG   ] summary = ERROR
2019-01-16 04:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182284  13 58499 15065209 A  ERRORERROR'
2019-01-16 04:11:05 [DEBUG   ] Got command RPT from MCS: ref #1182285
2019-01-16 04:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182285  77 58499 15065210 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:11:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 04:11:20 [DEBUG   ] Got command BAM from MCS: ref #1182302
2019-01-16 04:11:20 [INFO    ] Finished processing BAM request
2019-01-16 04:11:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:11:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182302   8 58499 15080029 A  ERROR'
2019-01-16 04:11:20 [DEBUG   ] Got command BAM from MCS: ref #1182301
2019-01-16 04:11:20 [INFO    ] Finished processing BAM request
2019-01-16 04:11:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:11:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182301   8 58499 15080033 A  ERROR'
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 04:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 04:11:20 [DEBUG   ] spawn_process: at 2019-01-16 04:11:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 04:11:34 [DEBUG   ] Got command RPT from MCS: ref #1182303
2019-01-16 04:11:34 [DEBUG   ] summary = ERROR
2019-01-16 04:11:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182303  13 58499 15094805 A  ERRORERROR'
2019-01-16 04:11:35 [DEBUG   ] Got command RPT from MCS: ref #1182304
2019-01-16 04:11:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:11:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182304  77 58499 15095009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:11:35 [DEBUG   ] Got command RPT from MCS: ref #1182305
2019-01-16 04:11:35 [DEBUG   ] summary = ERROR
2019-01-16 04:11:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182305  13 58499 15095201 A  ERRORERROR'
2019-01-16 04:11:35 [DEBUG   ] Got command RPT from MCS: ref #1182306
2019-01-16 04:11:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:11:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182306  77 58499 15095405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:11:35 [DEBUG   ] Got command RPT from MCS: ref #1182307
2019-01-16 04:11:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 04:11:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182307  12 58499 15095609 A  ERRORB£ff'
2019-01-16 04:11:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 04:11:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 04:12:00 [DEBUG   ] Got command BAM from MCS: ref #1182312
2019-01-16 04:12:00 [INFO    ] Finished processing BAM request
2019-01-16 04:12:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:12:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182312   8 58499 15120029 A  ERROR'
2019-01-16 04:12:00 [DEBUG   ] Got command BAM from MCS: ref #1182313
2019-01-16 04:12:00 [INFO    ] Finished processing BAM request
2019-01-16 04:12:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:12:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182313   8 58499 15120033 A  ERROR'
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 04:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 04:12:00 [DEBUG   ] spawn_process: at 2019-01-16 04:12:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 04:12:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:12:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-16 04:12:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:12:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-16 04:12:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 04:12:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:12:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:12:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:12:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:12:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:12:03 [DEBUG   ] Finished updating board flags in 1.238 seconds
2019-01-16 04:12:18 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2019-01-16 04:12:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 04:12:40 [DEBUG   ] Got command BAM from MCS: ref #1182314
2019-01-16 04:12:40 [INFO    ] Finished processing BAM request
2019-01-16 04:12:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182314   8 58499 15160029 A  ERROR'
2019-01-16 04:12:40 [DEBUG   ] Got command BAM from MCS: ref #1182315
2019-01-16 04:12:40 [INFO    ] Finished processing BAM request
2019-01-16 04:12:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182315   8 58499 15160033 A  ERROR'
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 04:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 04:12:40 [DEBUG   ] spawn_process: at 2019-01-16 04:12:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 04:12:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 04:13:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:13:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:13:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-16 04:13:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 04:13:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:13:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:13:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:13:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:13:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:13:03 [DEBUG   ] Finished updating board flags in 1.224 seconds
2019-01-16 04:13:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-16 04:13:20 [DEBUG   ] Got command BAM from MCS: ref #1182317
2019-01-16 04:13:20 [INFO    ] Finished processing BAM request
2019-01-16 04:13:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:13:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182317   8 58499 15200033 A  ERROR'
2019-01-16 04:13:20 [DEBUG   ] Got command BAM from MCS: ref #1182316
2019-01-16 04:13:20 [INFO    ] Finished processing BAM request
2019-01-16 04:13:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:13:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182316   8 58499 15200037 A  ERROR'
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 04:13:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 04:13:20 [DEBUG   ] spawn_process: at 2019-01-16 04:13:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 04:13:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 04:13:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 04:14:00 [DEBUG   ] Got command BAM from MCS: ref #1182319
2019-01-16 04:14:00 [INFO    ] Finished processing BAM request
2019-01-16 04:14:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:14:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182319   8 58499 15240025 A  ERROR'
2019-01-16 04:14:00 [DEBUG   ] Got command BAM from MCS: ref #1182318
2019-01-16 04:14:00 [INFO    ] Finished processing BAM request
2019-01-16 04:14:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:14:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182318   8 58499 15240029 A  ERROR'
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 04:14:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 04:14:00 [DEBUG   ] spawn_process: at 2019-01-16 04:14:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 04:14:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 04:14:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:14:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:14:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 04:14:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-01-16 04:14:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:14:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:14:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:14:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:14:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:14:03 [DEBUG   ] Finished updating board flags in 1.175 seconds
2019-01-16 04:14:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:14:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:14:40 [DEBUG   ] Got command BAM from MCS: ref #1182320
2019-01-16 04:14:40 [INFO    ] Finished processing BAM request
2019-01-16 04:14:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:14:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182320   8 58499 15280025 A  ERROR'
2019-01-16 04:14:40 [DEBUG   ] Got command BAM from MCS: ref #1182321
2019-01-16 04:14:40 [INFO    ] Finished processing BAM request
2019-01-16 04:14:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:14:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182321   8 58499 15280029 A  ERROR'
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 04:14:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 04:14:40 [DEBUG   ] spawn_process: at 2019-01-16 04:14:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 04:14:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 04:15:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 04:15:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-16 04:15:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:15:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-16 04:15:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:15:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:15:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:15:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:15:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:15:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:15:03 [DEBUG   ] Finished updating board flags in 1.044 seconds
2019-01-16 04:15:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 04:15:20 [DEBUG   ] Got command BAM from MCS: ref #1182326
2019-01-16 04:15:20 [INFO    ] Finished processing BAM request
2019-01-16 04:15:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:15:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182326   8 58499 15320033 A  ERROR'
2019-01-16 04:15:20 [DEBUG   ] Got command BAM from MCS: ref #1182327
2019-01-16 04:15:20 [INFO    ] Finished processing BAM request
2019-01-16 04:15:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:15:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182327   8 58499 15320037 A  ERROR'
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 04:15:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 04:15:20 [DEBUG   ] spawn_process: at 2019-01-16 04:15:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 04:15:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 04:15:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:16:00 [DEBUG   ] Got command BAM from MCS: ref #1182329
2019-01-16 04:16:00 [INFO    ] Finished processing BAM request
2019-01-16 04:16:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:16:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182329   8 58499 15360025 A  ERROR'
2019-01-16 04:16:00 [DEBUG   ] Got command BAM from MCS: ref #1182328
2019-01-16 04:16:00 [INFO    ] Finished processing BAM request
2019-01-16 04:16:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:16:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182328   8 58499 15360029 A  ERROR'
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 04:16:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 04:16:00 [DEBUG   ] spawn_process: at 2019-01-16 04:16:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 04:16:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:16:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 04:16:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 04:16:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:16:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:16:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:16:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:16:03 [WARNING ] (13, 1, 'bot')
2019-01-16 04:16:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:16:03 [DEBUG   ] Finished updating board flags in 0.957 seconds
2019-01-16 04:16:05 [DEBUG   ] Got command RPT from MCS: ref #1182330
2019-01-16 04:16:05 [DEBUG   ] summary = ERROR
2019-01-16 04:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182330  13 58499 15365205 A  ERRORERROR'
2019-01-16 04:16:05 [DEBUG   ] Got command RPT from MCS: ref #1182331
2019-01-16 04:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182331  77 58499 15365206 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:16:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:16:34 [DEBUG   ] Got command RPT from MCS: ref #1182349
2019-01-16 04:16:34 [DEBUG   ] summary = ERROR
2019-01-16 04:16:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182349  13 58499 15394889 A  ERRORERROR'
2019-01-16 04:16:35 [DEBUG   ] Got command RPT from MCS: ref #1182350
2019-01-16 04:16:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:16:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182350  77 58499 15395085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:16:35 [DEBUG   ] Got command RPT from MCS: ref #1182351
2019-01-16 04:16:35 [DEBUG   ] summary = ERROR
2019-01-16 04:16:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182351  13 58499 15395289 A  ERRORERROR'
2019-01-16 04:16:35 [DEBUG   ] Got command RPT from MCS: ref #1182353
2019-01-16 04:16:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:16:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182353  77 58499 15395493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:16:35 [DEBUG   ] Got command RPT from MCS: ref #1182354
2019-01-16 04:16:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 04:16:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182354  12 58499 15395697 A  ERRORB£ff'
2019-01-16 04:16:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:16:40 [DEBUG   ] Got command BAM from MCS: ref #1182359
2019-01-16 04:16:40 [INFO    ] Finished processing BAM request
2019-01-16 04:16:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:16:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182359   8 58499 15400025 A  ERROR'
2019-01-16 04:16:40 [DEBUG   ] Got command BAM from MCS: ref #1182360
2019-01-16 04:16:40 [INFO    ] Finished processing BAM request
2019-01-16 04:16:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:16:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182360   8 58499 15400029 A  ERROR'
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 04:16:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 04:16:40 [DEBUG   ] spawn_process: at 2019-01-16 04:16:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 04:16:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:17:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:17:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 04:17:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:17:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:17:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:17:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:17:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:17:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:17:04 [DEBUG   ] Finished updating board flags in 1.375 seconds
2019-01-16 04:17:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 04:17:20 [DEBUG   ] Got command BAM from MCS: ref #1182361
2019-01-16 04:17:20 [INFO    ] Finished processing BAM request
2019-01-16 04:17:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:17:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182361   8 58499 15440025 A  ERROR'
2019-01-16 04:17:20 [DEBUG   ] Got command BAM from MCS: ref #1182362
2019-01-16 04:17:20 [INFO    ] Finished processing BAM request
2019-01-16 04:17:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:17:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182362   8 58499 15440029 A  ERROR'
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 04:17:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 04:17:20 [DEBUG   ] spawn_process: at 2019-01-16 04:17:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 04:17:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:17:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 04:18:00 [DEBUG   ] Got command BAM from MCS: ref #1182368
2019-01-16 04:18:00 [INFO    ] Finished processing BAM request
2019-01-16 04:18:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:18:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182368   8 58499 15480025 A  ERROR'
2019-01-16 04:18:00 [DEBUG   ] Got command BAM from MCS: ref #1182367
2019-01-16 04:18:00 [INFO    ] Finished processing BAM request
2019-01-16 04:18:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:18:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182367   8 58499 15480029 A  ERROR'
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 04:18:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 04:18:00 [DEBUG   ] spawn_process: at 2019-01-16 04:18:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 04:18:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 04:18:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:18:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:18:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:18:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:18:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:18:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:18:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:18:04 [DEBUG   ] Finished updating board flags in 1.198 seconds
2019-01-16 04:18:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-16 04:18:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 04:18:40 [DEBUG   ] Got command BAM from MCS: ref #1182369
2019-01-16 04:18:40 [INFO    ] Finished processing BAM request
2019-01-16 04:18:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:18:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182369   8 58499 15520033 A  ERROR'
2019-01-16 04:18:40 [DEBUG   ] Got command BAM from MCS: ref #1182370
2019-01-16 04:18:40 [INFO    ] Finished processing BAM request
2019-01-16 04:18:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:18:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182370   8 58499 15520037 A  ERROR'
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 04:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 04:18:40 [DEBUG   ] spawn_process: at 2019-01-16 04:18:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 04:18:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 04:19:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 04:19:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-16 04:19:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 04:19:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:19:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:19:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:19:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:19:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:19:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:19:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:19:04 [DEBUG   ] Finished updating board flags in 1.015 seconds
2019-01-16 04:19:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 04:19:20 [DEBUG   ] Got command BAM from MCS: ref #1182372
2019-01-16 04:19:20 [INFO    ] Finished processing BAM request
2019-01-16 04:19:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182372   8 58499 15560029 A  ERROR'
2019-01-16 04:19:20 [DEBUG   ] Got command BAM from MCS: ref #1182371
2019-01-16 04:19:20 [INFO    ] Finished processing BAM request
2019-01-16 04:19:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182371   8 58499 15560033 A  ERROR'
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 04:19:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 04:19:20 [DEBUG   ] spawn_process: at 2019-01-16 04:19:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 04:19:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 04:19:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 04:20:00 [DEBUG   ] Got command BAM from MCS: ref #1182373
2019-01-16 04:20:00 [INFO    ] Finished processing BAM request
2019-01-16 04:20:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:20:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182373   8 58499 15600029 A  ERROR'
2019-01-16 04:20:00 [DEBUG   ] Got command BAM from MCS: ref #1182374
2019-01-16 04:20:00 [INFO    ] Finished processing BAM request
2019-01-16 04:20:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:20:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182374   8 58499 15600033 A  ERROR'
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 04:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 04:20:00 [DEBUG   ] spawn_process: at 2019-01-16 04:20:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 04:20:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:20:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:20:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:20:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:20:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:20:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:20:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:20:04 [DEBUG   ] Finished updating board flags in 0.986 seconds
2019-01-16 04:20:18 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-16 04:20:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 04:20:40 [DEBUG   ] Got command BAM from MCS: ref #1182375
2019-01-16 04:20:40 [INFO    ] Finished processing BAM request
2019-01-16 04:20:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182375   8 58499 15640029 A  ERROR'
2019-01-16 04:20:40 [DEBUG   ] Got command BAM from MCS: ref #1182376
2019-01-16 04:20:40 [INFO    ] Finished processing BAM request
2019-01-16 04:20:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:20:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182376   8 58499 15640033 A  ERROR'
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 04:20:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 04:20:40 [DEBUG   ] spawn_process: at 2019-01-16 04:20:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 04:20:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:21:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:21:05 [DEBUG   ] Got command RPT from MCS: ref #1182381
2019-01-16 04:21:05 [DEBUG   ] summary = ERROR
2019-01-16 04:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182381  13 58499 15665213 A  ERRORERROR'
2019-01-16 04:21:05 [DEBUG   ] Got command RPT from MCS: ref #1182382
2019-01-16 04:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182382  77 58499 15665214 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:21:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:21:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-16 04:21:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 04:21:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:21:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:21:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:21:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:21:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:21:05 [DEBUG   ] Finished updating board flags in 1.845 seconds
2019-01-16 04:21:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 04:21:20 [DEBUG   ] Got command BAM from MCS: ref #1182399
2019-01-16 04:21:20 [INFO    ] Finished processing BAM request
2019-01-16 04:21:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:21:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182399   8 58499 15680033 A  ERROR'
2019-01-16 04:21:20 [DEBUG   ] Got command BAM from MCS: ref #1182398
2019-01-16 04:21:20 [INFO    ] Finished processing BAM request
2019-01-16 04:21:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:21:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182398   8 58499 15680037 A  ERROR'
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 04:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 04:21:20 [DEBUG   ] spawn_process: at 2019-01-16 04:21:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 04:21:34 [DEBUG   ] Got command RPT from MCS: ref #1182400
2019-01-16 04:21:34 [DEBUG   ] summary = ERROR
2019-01-16 04:21:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182400  13 58499 15694977 A  ERRORERROR'
2019-01-16 04:21:35 [DEBUG   ] Got command RPT from MCS: ref #1182401
2019-01-16 04:21:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:21:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182401  77 58499 15695181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:21:35 [DEBUG   ] Got command RPT from MCS: ref #1182402
2019-01-16 04:21:35 [DEBUG   ] summary = ERROR
2019-01-16 04:21:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182402  13 58499 15695373 A  ERRORERROR'
2019-01-16 04:21:35 [DEBUG   ] Got command RPT from MCS: ref #1182403
2019-01-16 04:21:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:21:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182403  77 58499 15695577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:21:35 [DEBUG   ] Got command RPT from MCS: ref #1182404
2019-01-16 04:21:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 04:21:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182404  12 58499 15695781 A  ERRORB¡ff'
2019-01-16 04:21:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:21:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 04:22:00 [DEBUG   ] Got command BAM from MCS: ref #1182405
2019-01-16 04:22:00 [INFO    ] Finished processing BAM request
2019-01-16 04:22:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:22:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182405   8 58499 15720025 A  ERROR'
2019-01-16 04:22:00 [DEBUG   ] Got command BAM from MCS: ref #1182406
2019-01-16 04:22:00 [INFO    ] Finished processing BAM request
2019-01-16 04:22:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:22:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182406   8 58499 15720029 A  ERROR'
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 04:22:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 04:22:00 [DEBUG   ] spawn_process: at 2019-01-16 04:22:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 04:22:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:22:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:22:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:22:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:22:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:22:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:22:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:22:04 [DEBUG   ] Finished updating board flags in 1.201 seconds
2019-01-16 04:22:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:22:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 04:22:40 [DEBUG   ] Got command BAM from MCS: ref #1182408
2019-01-16 04:22:40 [INFO    ] Finished processing BAM request
2019-01-16 04:22:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182408   8 58499 15760033 A  ERROR'
2019-01-16 04:22:40 [DEBUG   ] Got command BAM from MCS: ref #1182407
2019-01-16 04:22:40 [INFO    ] Finished processing BAM request
2019-01-16 04:22:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182407   8 58499 15760037 A  ERROR'
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 04:22:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 04:22:40 [DEBUG   ] spawn_process: at 2019-01-16 04:22:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 04:22:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:23:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-16 04:23:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 04:23:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2019-01-16 04:23:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:23:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:23:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:23:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:23:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:23:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:23:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:23:05 [DEBUG   ] Finished updating board flags in 1.813 seconds
2019-01-16 04:23:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 04:23:20 [DEBUG   ] Got command BAM from MCS: ref #1182410
2019-01-16 04:23:20 [INFO    ] Finished processing BAM request
2019-01-16 04:23:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182410   8 58499 15800029 A  ERROR'
2019-01-16 04:23:20 [DEBUG   ] Got command BAM from MCS: ref #1182409
2019-01-16 04:23:20 [INFO    ] Finished processing BAM request
2019-01-16 04:23:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182409   8 58499 15800033 A  ERROR'
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 04:23:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 04:23:20 [DEBUG   ] spawn_process: at 2019-01-16 04:23:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 04:23:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:23:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:24:00 [DEBUG   ] Got command BAM from MCS: ref #1182415
2019-01-16 04:24:00 [INFO    ] Finished processing BAM request
2019-01-16 04:24:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:24:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182415   8 58499 15840029 A  ERROR'
2019-01-16 04:24:00 [DEBUG   ] Got command BAM from MCS: ref #1182416
2019-01-16 04:24:00 [INFO    ] Finished processing BAM request
2019-01-16 04:24:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:24:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182416   8 58499 15840033 A  ERROR'
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 04:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 04:24:00 [DEBUG   ] spawn_process: at 2019-01-16 04:24:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 04:24:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 04:24:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2019-01-16 04:24:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:24:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 04:24:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 04:24:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:24:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:24:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:24:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:24:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:24:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:24:04 [DEBUG   ] Finished updating board flags in 1.184 seconds
2019-01-16 04:24:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 04:24:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:24:40 [DEBUG   ] Got command BAM from MCS: ref #1182417
2019-01-16 04:24:40 [INFO    ] Finished processing BAM request
2019-01-16 04:24:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:24:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182417   8 58499 15880033 A  ERROR'
2019-01-16 04:24:40 [DEBUG   ] Got command BAM from MCS: ref #1182418
2019-01-16 04:24:40 [INFO    ] Finished processing BAM request
2019-01-16 04:24:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:24:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182418   8 58499 15880037 A  ERROR'
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 04:24:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 04:24:40 [DEBUG   ] spawn_process: at 2019-01-16 04:24:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 04:24:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:25:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 04:25:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:25:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:25:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-16 04:25:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:25:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:25:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:25:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:25:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:25:04 [DEBUG   ] Finished updating board flags in 1.032 seconds
2019-01-16 04:25:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-16 04:25:20 [DEBUG   ] Got command BAM from MCS: ref #1182419
2019-01-16 04:25:20 [INFO    ] Finished processing BAM request
2019-01-16 04:25:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:25:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182419   8 58499 15920033 A  ERROR'
2019-01-16 04:25:20 [DEBUG   ] Got command BAM from MCS: ref #1182420
2019-01-16 04:25:20 [INFO    ] Finished processing BAM request
2019-01-16 04:25:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:25:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182420   8 58499 15920037 A  ERROR'
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 04:25:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 04:25:20 [DEBUG   ] spawn_process: at 2019-01-16 04:25:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 04:25:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 04:25:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 04:26:00 [DEBUG   ] Got command BAM from MCS: ref #1182422
2019-01-16 04:26:00 [INFO    ] Finished processing BAM request
2019-01-16 04:26:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:26:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182422   8 58499 15960025 A  ERROR'
2019-01-16 04:26:00 [DEBUG   ] Got command BAM from MCS: ref #1182421
2019-01-16 04:26:00 [INFO    ] Finished processing BAM request
2019-01-16 04:26:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:26:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182421   8 58499 15960029 A  ERROR'
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 04:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 04:26:00 [DEBUG   ] spawn_process: at 2019-01-16 04:26:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 04:26:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:26:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:26:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:26:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:26:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:26:04 [WARNING ] (13, 1, 'bot')
2019-01-16 04:26:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:26:04 [DEBUG   ] Finished updating board flags in 0.969 seconds
2019-01-16 04:26:05 [DEBUG   ] Got command RPT from MCS: ref #1182423
2019-01-16 04:26:05 [DEBUG   ] summary = ERROR
2019-01-16 04:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182423  13 58499 15965209 A  ERRORERROR'
2019-01-16 04:26:05 [DEBUG   ] Got command RPT from MCS: ref #1182424
2019-01-16 04:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182424  77 58499 15965210 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:26:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 04:26:35 [DEBUG   ] Got command RPT from MCS: ref #1182442
2019-01-16 04:26:35 [DEBUG   ] summary = ERROR
2019-01-16 04:26:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182442  13 58499 15995057 A  ERRORERROR'
2019-01-16 04:26:35 [DEBUG   ] Got command RPT from MCS: ref #1182443
2019-01-16 04:26:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:26:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182443  77 58499 15995261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:26:35 [DEBUG   ] Got command RPT from MCS: ref #1182444
2019-01-16 04:26:35 [DEBUG   ] summary = ERROR
2019-01-16 04:26:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182444  13 58499 15995490 A  ERRORERROR'
2019-01-16 04:26:35 [DEBUG   ] Got command RPT from MCS: ref #1182446
2019-01-16 04:26:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:26:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182446  77 58499 15995669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:26:35 [DEBUG   ] Got command RPT from MCS: ref #1182447
2019-01-16 04:26:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 04:26:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182447  12 58499 15995861 A  ERRORB¢ff'
2019-01-16 04:26:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 04:26:40 [DEBUG   ] Got command BAM from MCS: ref #1182452
2019-01-16 04:26:40 [INFO    ] Finished processing BAM request
2019-01-16 04:26:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:26:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182452   8 58499 16000029 A  ERROR'
2019-01-16 04:26:40 [DEBUG   ] Got command BAM from MCS: ref #1182453
2019-01-16 04:26:40 [INFO    ] Finished processing BAM request
2019-01-16 04:26:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:26:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182453   8 58499 16000033 A  ERROR'
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 04:26:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 04:26:40 [DEBUG   ] spawn_process: at 2019-01-16 04:26:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 04:26:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 04:27:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 04:27:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:27:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 04:27:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:27:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 04:27:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:27:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:27:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:27:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:27:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:27:05 [DEBUG   ] Finished updating board flags in 1.379 seconds
2019-01-16 04:27:19 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-16 04:27:20 [DEBUG   ] Got command BAM from MCS: ref #1182458
2019-01-16 04:27:20 [INFO    ] Finished processing BAM request
2019-01-16 04:27:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:27:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182458   8 58499 16040033 A  ERROR'
2019-01-16 04:27:20 [DEBUG   ] Got command BAM from MCS: ref #1182459
2019-01-16 04:27:20 [INFO    ] Finished processing BAM request
2019-01-16 04:27:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:27:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182459   8 58499 16040037 A  ERROR'
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 04:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 04:27:20 [DEBUG   ] spawn_process: at 2019-01-16 04:27:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 04:27:39 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-16 04:27:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:28:00 [DEBUG   ] Got command BAM from MCS: ref #1182461
2019-01-16 04:28:00 [INFO    ] Finished processing BAM request
2019-01-16 04:28:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:28:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182461   8 58499 16080029 A  ERROR'
2019-01-16 04:28:00 [DEBUG   ] Got command BAM from MCS: ref #1182460
2019-01-16 04:28:00 [INFO    ] Finished processing BAM request
2019-01-16 04:28:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:28:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182460   8 58499 16080033 A  ERROR'
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 04:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 04:28:00 [DEBUG   ] spawn_process: at 2019-01-16 04:28:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 04:28:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:28:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:28:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:28:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:28:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:28:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:28:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:28:05 [DEBUG   ] Finished updating board flags in 1.187 seconds
2019-01-16 04:28:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:28:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:28:40 [DEBUG   ] Got command BAM from MCS: ref #1182462
2019-01-16 04:28:40 [INFO    ] Finished processing BAM request
2019-01-16 04:28:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:28:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182462   8 58499 16120029 A  ERROR'
2019-01-16 04:28:40 [DEBUG   ] Got command BAM from MCS: ref #1182463
2019-01-16 04:28:40 [INFO    ] Finished processing BAM request
2019-01-16 04:28:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:28:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182463   8 58499 16120033 A  ERROR'
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 04:28:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 04:28:40 [DEBUG   ] spawn_process: at 2019-01-16 04:28:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 04:28:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:29:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 04:29:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:29:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:29:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 04:29:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:29:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:29:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:29:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:29:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:29:05 [DEBUG   ] Finished updating board flags in 1.042 seconds
2019-01-16 04:29:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:29:20 [DEBUG   ] Got command BAM from MCS: ref #1182465
2019-01-16 04:29:20 [INFO    ] Finished processing BAM request
2019-01-16 04:29:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182465   8 58499 16160025 A  ERROR'
2019-01-16 04:29:20 [DEBUG   ] Got command BAM from MCS: ref #1182464
2019-01-16 04:29:20 [INFO    ] Finished processing BAM request
2019-01-16 04:29:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182464   8 58499 16160029 A  ERROR'
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 04:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 04:29:20 [DEBUG   ] spawn_process: at 2019-01-16 04:29:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 04:29:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:29:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:30:00 [DEBUG   ] Got command BAM from MCS: ref #1182470
2019-01-16 04:30:00 [INFO    ] Finished processing BAM request
2019-01-16 04:30:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182470   8 58499 16200033 A  ERROR'
2019-01-16 04:30:00 [DEBUG   ] Got command BAM from MCS: ref #1182471
2019-01-16 04:30:00 [INFO    ] Finished processing BAM request
2019-01-16 04:30:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182471   8 58499 16200037 A  ERROR'
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 04:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 04:30:00 [DEBUG   ] spawn_process: at 2019-01-16 04:30:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 04:30:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 04:30:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:30:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:30:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 04:30:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:30:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:30:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:30:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:30:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:30:06 [DEBUG   ] Finished updating board flags in 2.013 seconds
2019-01-16 04:30:19 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-16 04:30:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 04:30:40 [DEBUG   ] Got command BAM from MCS: ref #1182473
2019-01-16 04:30:40 [INFO    ] Finished processing BAM request
2019-01-16 04:30:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182473   8 58499 16240033 A  ERROR'
2019-01-16 04:30:40 [DEBUG   ] Got command BAM from MCS: ref #1182472
2019-01-16 04:30:40 [INFO    ] Finished processing BAM request
2019-01-16 04:30:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:30:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182472   8 58499 16240037 A  ERROR'
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 04:30:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 04:30:40 [DEBUG   ] spawn_process: at 2019-01-16 04:30:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 04:30:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 04:31:05 [DEBUG   ] Got command RPT from MCS: ref #1182474
2019-01-16 04:31:05 [DEBUG   ] summary = ERROR
2019-01-16 04:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182474  13 58499 16265213 A  ERRORERROR'
2019-01-16 04:31:05 [DEBUG   ] Got command RPT from MCS: ref #1182475
2019-01-16 04:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182475  77 58499 16265214 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:31:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:31:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:31:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:31:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:31:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:31:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:31:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:31:05 [DEBUG   ] Finished updating board flags in 1.408 seconds
2019-01-16 04:31:19 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-16 04:31:20 [DEBUG   ] Got command BAM from MCS: ref #1182491
2019-01-16 04:31:20 [INFO    ] Finished processing BAM request
2019-01-16 04:31:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:31:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182491   8 58499 16280025 A  ERROR'
2019-01-16 04:31:20 [DEBUG   ] Got command BAM from MCS: ref #1182492
2019-01-16 04:31:20 [INFO    ] Finished processing BAM request
2019-01-16 04:31:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:31:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182492   8 58499 16280029 A  ERROR'
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 04:31:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 04:31:20 [DEBUG   ] spawn_process: at 2019-01-16 04:31:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 04:31:35 [DEBUG   ] Got command RPT from MCS: ref #1182493
2019-01-16 04:31:35 [DEBUG   ] summary = ERROR
2019-01-16 04:31:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182493  13 58499 16295153 A  ERRORERROR'
2019-01-16 04:31:35 [DEBUG   ] Got command RPT from MCS: ref #1182494
2019-01-16 04:31:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:31:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182494  77 58499 16295345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:31:35 [DEBUG   ] Got command RPT from MCS: ref #1182495
2019-01-16 04:31:35 [DEBUG   ] summary = ERROR
2019-01-16 04:31:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182495  13 58499 16295549 A  ERRORERROR'
2019-01-16 04:31:35 [DEBUG   ] Got command RPT from MCS: ref #1182496
2019-01-16 04:31:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:31:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182496  77 58499 16295753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:31:35 [DEBUG   ] Got command RPT from MCS: ref #1182497
2019-01-16 04:31:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 04:31:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182497  12 58499 16295957 A  ERRORB¢ff'
2019-01-16 04:31:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 04:31:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 04:32:00 [DEBUG   ] Got command BAM from MCS: ref #1182498
2019-01-16 04:32:00 [INFO    ] Finished processing BAM request
2019-01-16 04:32:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:32:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182498   8 58499 16320033 A  ERROR'
2019-01-16 04:32:00 [DEBUG   ] Got command BAM from MCS: ref #1182499
2019-01-16 04:32:00 [INFO    ] Finished processing BAM request
2019-01-16 04:32:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:32:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182499   8 58499 16320037 A  ERROR'
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 04:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 04:32:00 [DEBUG   ] spawn_process: at 2019-01-16 04:32:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 04:32:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 04:32:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:32:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:32:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:32:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:32:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:32:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:32:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:32:05 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-01-16 04:32:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 04:32:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 04:32:40 [DEBUG   ] Got command BAM from MCS: ref #1182501
2019-01-16 04:32:40 [INFO    ] Finished processing BAM request
2019-01-16 04:32:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182501   8 58499 16360029 A  ERROR'
2019-01-16 04:32:40 [DEBUG   ] Got command BAM from MCS: ref #1182500
2019-01-16 04:32:40 [INFO    ] Finished processing BAM request
2019-01-16 04:32:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182500   8 58499 16360033 A  ERROR'
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 04:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 04:32:40 [DEBUG   ] spawn_process: at 2019-01-16 04:32:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 04:32:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 04:33:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 04:33:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:33:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:33:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 04:33:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:33:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:33:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:33:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:33:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:33:06 [DEBUG   ] Finished updating board flags in 1.981 seconds
2019-01-16 04:33:19 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-16 04:33:20 [DEBUG   ] Got command BAM from MCS: ref #1182506
2019-01-16 04:33:20 [INFO    ] Finished processing BAM request
2019-01-16 04:33:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:33:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182506   8 58499 16400033 A  ERROR'
2019-01-16 04:33:20 [DEBUG   ] Got command BAM from MCS: ref #1182507
2019-01-16 04:33:20 [INFO    ] Finished processing BAM request
2019-01-16 04:33:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:33:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182507   8 58499 16400037 A  ERROR'
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 04:33:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 04:33:20 [DEBUG   ] spawn_process: at 2019-01-16 04:33:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 04:33:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:34:00 [DEBUG   ] Got command BAM from MCS: ref #1182509
2019-01-16 04:34:00 [INFO    ] Finished processing BAM request
2019-01-16 04:34:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:34:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182509   8 58499 16440029 A  ERROR'
2019-01-16 04:34:00 [DEBUG   ] Got command BAM from MCS: ref #1182508
2019-01-16 04:34:00 [INFO    ] Finished processing BAM request
2019-01-16 04:34:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:34:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182508   8 58499 16440033 A  ERROR'
2019-01-16 04:34:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 04:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 04:34:00 [DEBUG   ] spawn_process: at 2019-01-16 04:34:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 04:34:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:34:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 04:34:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:34:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 04:34:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:34:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:34:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:34:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:34:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:34:05 [DEBUG   ] Finished updating board flags in 1.192 seconds
2019-01-16 04:34:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:34:40 [DEBUG   ] Got command BAM from MCS: ref #1182511
2019-01-16 04:34:40 [INFO    ] Finished processing BAM request
2019-01-16 04:34:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:34:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182511   8 58499 16480029 A  ERROR'
2019-01-16 04:34:40 [DEBUG   ] Got command BAM from MCS: ref #1182510
2019-01-16 04:34:40 [INFO    ] Finished processing BAM request
2019-01-16 04:34:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:34:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182510   8 58499 16480033 A  ERROR'
2019-01-16 04:34:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 04:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 04:34:40 [DEBUG   ] spawn_process: at 2019-01-16 04:34:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 04:35:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:35:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 04:35:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:35:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:35:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:35:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:35:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:35:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:35:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:35:05 [DEBUG   ] Finished updating board flags in 1.016 seconds
2019-01-16 04:35:20 [DEBUG   ] Got command BAM from MCS: ref #1182512
2019-01-16 04:35:20 [INFO    ] Finished processing BAM request
2019-01-16 04:35:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:35:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182512   8 58499 16520029 A  ERROR'
2019-01-16 04:35:20 [DEBUG   ] Got command BAM from MCS: ref #1182513
2019-01-16 04:35:20 [INFO    ] Finished processing BAM request
2019-01-16 04:35:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:35:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182513   8 58499 16520033 A  ERROR'
2019-01-16 04:35:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 04:35:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 04:35:20 [DEBUG   ] spawn_process: at 2019-01-16 04:35:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 04:35:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:36:00 [DEBUG   ] Got command BAM from MCS: ref #1182519
2019-01-16 04:36:00 [INFO    ] Finished processing BAM request
2019-01-16 04:36:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:36:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182519   8 58499 16560025 A  ERROR'
2019-01-16 04:36:00 [DEBUG   ] Got command BAM from MCS: ref #1182518
2019-01-16 04:36:00 [INFO    ] Finished processing BAM request
2019-01-16 04:36:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:36:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182518   8 58499 16560029 A  ERROR'
2019-01-16 04:36:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 04:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 04:36:00 [DEBUG   ] spawn_process: at 2019-01-16 04:36:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 04:36:05 [DEBUG   ] Got command RPT from MCS: ref #1182520
2019-01-16 04:36:05 [DEBUG   ] summary = ERROR
2019-01-16 04:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182520  13 58499 16565214 A  ERRORERROR'
2019-01-16 04:36:05 [DEBUG   ] Got command RPT from MCS: ref #1182521
2019-01-16 04:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182521  77 58499 16565214 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:36:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 04:36:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:36:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:36:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 04:36:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:36:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:36:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:36:05 [WARNING ] (13, 1, 'bot')
2019-01-16 04:36:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:36:05 [DEBUG   ] Finished updating board flags in 1.006 seconds
2019-01-16 04:36:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:36:35 [DEBUG   ] Got command RPT from MCS: ref #1182539
2019-01-16 04:36:35 [DEBUG   ] summary = ERROR
2019-01-16 04:36:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182539  13 58499 16595229 A  ERRORERROR'
2019-01-16 04:36:35 [DEBUG   ] Got command RPT from MCS: ref #1182540
2019-01-16 04:36:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:36:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182540  77 58499 16595433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:36:35 [DEBUG   ] Got command RPT from MCS: ref #1182541
2019-01-16 04:36:35 [DEBUG   ] summary = ERROR
2019-01-16 04:36:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182541  13 58499 16595637 A  ERRORERROR'
2019-01-16 04:36:35 [DEBUG   ] Got command RPT from MCS: ref #1182543
2019-01-16 04:36:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:36:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182543  77 58499 16595833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:36:36 [DEBUG   ] Got command RPT from MCS: ref #1182544
2019-01-16 04:36:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 04:36:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182544  12 58499 16596037 A  ERRORB£ff'
2019-01-16 04:36:40 [DEBUG   ] Got command BAM from MCS: ref #1182550
2019-01-16 04:36:40 [INFO    ] Finished processing BAM request
2019-01-16 04:36:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:36:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182550   8 58499 16600033 A  ERROR'
2019-01-16 04:36:40 [DEBUG   ] Got command BAM from MCS: ref #1182549
2019-01-16 04:36:40 [INFO    ] Finished processing BAM request
2019-01-16 04:36:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:36:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182549   8 58499 16600037 A  ERROR'
2019-01-16 04:36:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 04:36:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 04:36:40 [DEBUG   ] spawn_process: at 2019-01-16 04:36:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 04:37:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:37:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 04:37:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:37:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:37:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:37:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:37:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:37:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:37:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:37:06 [DEBUG   ] Finished updating board flags in 1.580 seconds
2019-01-16 04:37:20 [DEBUG   ] Got command BAM from MCS: ref #1182552
2019-01-16 04:37:20 [INFO    ] Finished processing BAM request
2019-01-16 04:37:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:37:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182552   8 58499 16640033 A  ERROR'
2019-01-16 04:37:20 [DEBUG   ] Got command BAM from MCS: ref #1182551
2019-01-16 04:37:20 [INFO    ] Finished processing BAM request
2019-01-16 04:37:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:37:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182551   8 58499 16640037 A  ERROR'
2019-01-16 04:37:20 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 04:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 04:37:20 [DEBUG   ] spawn_process: at 2019-01-16 04:37:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 04:37:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 04:38:00 [DEBUG   ] Got command BAM from MCS: ref #1182553
2019-01-16 04:38:00 [INFO    ] Finished processing BAM request
2019-01-16 04:38:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:38:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182553   8 58499 16680033 A  ERROR'
2019-01-16 04:38:00 [DEBUG   ] Got command BAM from MCS: ref #1182554
2019-01-16 04:38:00 [INFO    ] Finished processing BAM request
2019-01-16 04:38:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:38:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182554   8 58499 16680037 A  ERROR'
2019-01-16 04:38:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 04:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 04:38:00 [DEBUG   ] spawn_process: at 2019-01-16 04:38:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 04:38:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:38:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:38:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 04:38:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:38:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:38:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:38:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:38:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:38:06 [DEBUG   ] Finished updating board flags in 1.407 seconds
2019-01-16 04:38:20 [DEBUG   ] Finished updating ant stats in 0.983 seconds
2019-01-16 04:38:40 [DEBUG   ] Got command BAM from MCS: ref #1182556
2019-01-16 04:38:40 [INFO    ] Finished processing BAM request
2019-01-16 04:38:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:38:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182556   8 58499 16720025 A  ERROR'
2019-01-16 04:38:40 [DEBUG   ] Got command BAM from MCS: ref #1182555
2019-01-16 04:38:40 [INFO    ] Finished processing BAM request
2019-01-16 04:38:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:38:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182555   8 58499 16720029 A  ERROR'
2019-01-16 04:38:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 04:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 04:38:40 [DEBUG   ] spawn_process: at 2019-01-16 04:38:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 04:39:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 04:39:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 04:39:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:39:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:39:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:39:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:39:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:39:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:39:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:39:06 [DEBUG   ] Finished updating board flags in 1.362 seconds
2019-01-16 04:39:20 [DEBUG   ] Got command BAM from MCS: ref #1182562
2019-01-16 04:39:20 [INFO    ] Finished processing BAM request
2019-01-16 04:39:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182562   8 58499 16760033 A  ERROR'
2019-01-16 04:39:20 [DEBUG   ] Got command BAM from MCS: ref #1182561
2019-01-16 04:39:20 [INFO    ] Finished processing BAM request
2019-01-16 04:39:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182561   8 58499 16760037 A  ERROR'
2019-01-16 04:39:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 04:39:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 04:39:20 [DEBUG   ] spawn_process: at 2019-01-16 04:39:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 04:39:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 04:40:00 [DEBUG   ] Got command BAM from MCS: ref #1182563
2019-01-16 04:40:00 [INFO    ] Finished processing BAM request
2019-01-16 04:40:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:40:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182563   8 58499 16800033 A  ERROR'
2019-01-16 04:40:00 [DEBUG   ] Got command BAM from MCS: ref #1182564
2019-01-16 04:40:00 [INFO    ] Finished processing BAM request
2019-01-16 04:40:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:40:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182564   8 58499 16800037 A  ERROR'
2019-01-16 04:40:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 04:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 04:40:00 [DEBUG   ] spawn_process: at 2019-01-16 04:40:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 04:40:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:40:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-01-16 04:40:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:40:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:40:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:40:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:40:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:40:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:40:06 [DEBUG   ] Finished updating board flags in 1.206 seconds
2019-01-16 04:40:20 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-16 04:40:40 [DEBUG   ] Got command BAM from MCS: ref #1182566
2019-01-16 04:40:40 [INFO    ] Finished processing BAM request
2019-01-16 04:40:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182566   8 58499 16840033 A  ERROR'
2019-01-16 04:40:40 [DEBUG   ] Got command BAM from MCS: ref #1182565
2019-01-16 04:40:40 [INFO    ] Finished processing BAM request
2019-01-16 04:40:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182565   8 58499 16840037 A  ERROR'
2019-01-16 04:40:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 04:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 04:40:40 [DEBUG   ] spawn_process: at 2019-01-16 04:40:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 04:41:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:41:05 [DEBUG   ] Got command RPT from MCS: ref #1182567
2019-01-16 04:41:05 [DEBUG   ] summary = ERROR
2019-01-16 04:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182567  13 58499 16865213 A  ERRORERROR'
2019-01-16 04:41:05 [DEBUG   ] Got command RPT from MCS: ref #1182568
2019-01-16 04:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182568  77 58499 16865214 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:41:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:41:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 04:41:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 04:41:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:41:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:41:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:41:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:41:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:41:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:41:06 [DEBUG   ] Finished updating board flags in 1.189 seconds
2019-01-16 04:41:20 [DEBUG   ] Got command BAM from MCS: ref #1182584
2019-01-16 04:41:20 [INFO    ] Finished processing BAM request
2019-01-16 04:41:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:41:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182584   8 58499 16880025 A  ERROR'
2019-01-16 04:41:20 [DEBUG   ] Got command BAM from MCS: ref #1182585
2019-01-16 04:41:20 [INFO    ] Finished processing BAM request
2019-01-16 04:41:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:41:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182585   8 58499 16880029 A  ERROR'
2019-01-16 04:41:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 04:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 04:41:20 [DEBUG   ] spawn_process: at 2019-01-16 04:41:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 04:41:35 [DEBUG   ] Got command RPT from MCS: ref #1182586
2019-01-16 04:41:35 [DEBUG   ] summary = ERROR
2019-01-16 04:41:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182586  13 58499 16895321 A  ERRORERROR'
2019-01-16 04:41:35 [DEBUG   ] Got command RPT from MCS: ref #1182587
2019-01-16 04:41:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:41:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182587  77 58499 16895525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:41:35 [DEBUG   ] Got command RPT from MCS: ref #1182588
2019-01-16 04:41:35 [DEBUG   ] summary = ERROR
2019-01-16 04:41:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182588  13 58499 16895717 A  ERRORERROR'
2019-01-16 04:41:35 [DEBUG   ] Got command RPT from MCS: ref #1182589
2019-01-16 04:41:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:41:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182589  77 58499 16895921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:41:36 [DEBUG   ] Got command RPT from MCS: ref #1182590
2019-01-16 04:41:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 04:41:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182590  12 58499 16896125 A  ERRORB¢ff'
2019-01-16 04:41:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:42:00 [DEBUG   ] Got command BAM from MCS: ref #1182596
2019-01-16 04:42:00 [INFO    ] Finished processing BAM request
2019-01-16 04:42:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:42:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182596   8 58499 16920033 A  ERROR'
2019-01-16 04:42:00 [DEBUG   ] Got command BAM from MCS: ref #1182595
2019-01-16 04:42:00 [INFO    ] Finished processing BAM request
2019-01-16 04:42:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:42:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182595   8 58499 16920041 A  ERROR'
2019-01-16 04:42:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 04:42:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 04:42:00 [DEBUG   ] spawn_process: at 2019-01-16 04:42:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 04:42:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:42:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 04:42:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:42:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 04:42:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:42:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:42:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:42:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:42:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:42:06 [DEBUG   ] Finished updating board flags in 1.012 seconds
2019-01-16 04:42:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:42:40 [DEBUG   ] Got command BAM from MCS: ref #1182598
2019-01-16 04:42:40 [INFO    ] Finished processing BAM request
2019-01-16 04:42:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182598   8 58499 16960033 A  ERROR'
2019-01-16 04:42:40 [DEBUG   ] Got command BAM from MCS: ref #1182597
2019-01-16 04:42:40 [INFO    ] Finished processing BAM request
2019-01-16 04:42:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182597   8 58499 16960037 A  ERROR'
2019-01-16 04:42:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 04:42:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 04:42:40 [DEBUG   ] spawn_process: at 2019-01-16 04:42:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 04:43:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:43:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:43:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-16 04:43:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 04:43:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:43:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:43:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:43:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:43:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:43:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:43:06 [DEBUG   ] Finished updating board flags in 1.053 seconds
2019-01-16 04:43:20 [DEBUG   ] Got command BAM from MCS: ref #1182599
2019-01-16 04:43:20 [INFO    ] Finished processing BAM request
2019-01-16 04:43:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:43:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182599   8 58499 17000029 A  ERROR'
2019-01-16 04:43:20 [DEBUG   ] Got command BAM from MCS: ref #1182600
2019-01-16 04:43:20 [INFO    ] Finished processing BAM request
2019-01-16 04:43:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:43:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182600   8 58499 17000033 A  ERROR'
2019-01-16 04:43:20 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 04:43:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 04:43:20 [DEBUG   ] spawn_process: at 2019-01-16 04:43:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 04:43:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 04:44:00 [DEBUG   ] Got command BAM from MCS: ref #1182602
2019-01-16 04:44:00 [INFO    ] Finished processing BAM request
2019-01-16 04:44:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:44:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182602   8 58499 17040025 A  ERROR'
2019-01-16 04:44:00 [DEBUG   ] Got command BAM from MCS: ref #1182601
2019-01-16 04:44:00 [INFO    ] Finished processing BAM request
2019-01-16 04:44:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:44:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182601   8 58499 17040029 A  ERROR'
2019-01-16 04:44:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 04:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 04:44:00 [DEBUG   ] spawn_process: at 2019-01-16 04:44:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 04:44:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 04:44:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:44:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:44:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:44:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:44:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:44:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:44:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:44:07 [DEBUG   ] Finished updating board flags in 1.997 seconds
2019-01-16 04:44:20 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-16 04:44:41 [DEBUG   ] Got command BAM from MCS: ref #1182604
2019-01-16 04:44:41 [INFO    ] Finished processing BAM request
2019-01-16 04:44:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:44:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182604   8 58499 17081033 A  ERROR'
2019-01-16 04:44:41 [DEBUG   ] Got command BAM from MCS: ref #1182603
2019-01-16 04:44:41 [INFO    ] Finished processing BAM request
2019-01-16 04:44:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:44:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182603   8 58499 17081037 A  ERROR'
2019-01-16 04:44:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 04:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 04:44:41 [DEBUG   ] spawn_process: at 2019-01-16 04:44:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 04:45:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 04:45:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-16 04:45:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 04:45:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:45:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:45:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:45:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:45:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:45:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:45:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:45:07 [DEBUG   ] Finished updating board flags in 1.806 seconds
2019-01-16 04:45:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-16 04:45:22 [DEBUG   ] Got command BAM from MCS: ref #1182609
2019-01-16 04:45:22 [INFO    ] Finished processing BAM request
2019-01-16 04:45:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:45:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182609   8 58499 17122033 A  ERROR'
2019-01-16 04:45:22 [DEBUG   ] Got command BAM from MCS: ref #1182610
2019-01-16 04:45:22 [INFO    ] Finished processing BAM request
2019-01-16 04:45:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:45:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182610   8 58499 17122037 A  ERROR'
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 04:45:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 04:45:22 [DEBUG   ] spawn_process: at 2019-01-16 04:45:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 04:45:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 04:46:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 04:46:03 [DEBUG   ] Got command BAM from MCS: ref #1182611
2019-01-16 04:46:03 [INFO    ] Finished processing BAM request
2019-01-16 04:46:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:46:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182611   8 58499 17163033 A  ERROR'
2019-01-16 04:46:03 [DEBUG   ] Got command BAM from MCS: ref #1182612
2019-01-16 04:46:03 [INFO    ] Finished processing BAM request
2019-01-16 04:46:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:46:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182612   8 58499 17163037 A  ERROR'
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 04:46:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 04:46:03 [DEBUG   ] spawn_process: at 2019-01-16 04:46:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 04:46:05 [DEBUG   ] Got command RPT from MCS: ref #1182613
2019-01-16 04:46:05 [DEBUG   ] summary = ERROR
2019-01-16 04:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182613  13 58499 17165221 A  ERRORERROR'
2019-01-16 04:46:05 [DEBUG   ] Got command RPT from MCS: ref #1182614
2019-01-16 04:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182614  77 58499 17165222 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:46:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:46:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:46:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 04:46:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 04:46:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:46:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:46:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:46:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:46:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:46:06 [DEBUG   ] Finished updating board flags in 1.174 seconds
2019-01-16 04:46:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-16 04:46:35 [DEBUG   ] Got command RPT from MCS: ref #1182632
2019-01-16 04:46:35 [DEBUG   ] summary = ERROR
2019-01-16 04:46:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182632  13 58499 17195401 A  ERRORERROR'
2019-01-16 04:46:35 [DEBUG   ] Got command RPT from MCS: ref #1182633
2019-01-16 04:46:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:46:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182633  77 58499 17195605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:46:35 [DEBUG   ] Got command RPT from MCS: ref #1182634
2019-01-16 04:46:35 [DEBUG   ] summary = ERROR
2019-01-16 04:46:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182634  13 58499 17195809 A  ERRORERROR'
2019-01-16 04:46:36 [DEBUG   ] Got command RPT from MCS: ref #1182636
2019-01-16 04:46:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:46:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182636  77 58499 17196013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:46:36 [DEBUG   ] Got command RPT from MCS: ref #1182637
2019-01-16 04:46:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 04:46:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182637  12 58499 17196205 A  ERRORB£ff'
2019-01-16 04:46:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 04:46:44 [DEBUG   ] Got command BAM from MCS: ref #1182643
2019-01-16 04:46:44 [INFO    ] Finished processing BAM request
2019-01-16 04:46:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:46:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182643   8 58499 17204025 A  ERROR'
2019-01-16 04:46:44 [DEBUG   ] Got command BAM from MCS: ref #1182642
2019-01-16 04:46:44 [INFO    ] Finished processing BAM request
2019-01-16 04:46:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:46:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182642   8 58499 17204029 A  ERROR'
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 04:46:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 04:46:44 [DEBUG   ] spawn_process: at 2019-01-16 04:46:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 04:47:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 04:47:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 04:47:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:47:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:47:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 04:47:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:47:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:47:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:47:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:47:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:47:06 [DEBUG   ] Finished updating board flags in 1.023 seconds
2019-01-16 04:47:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 04:47:25 [DEBUG   ] Got command BAM from MCS: ref #1182645
2019-01-16 04:47:25 [INFO    ] Finished processing BAM request
2019-01-16 04:47:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:47:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182645   8 58499 17245025 A  ERROR'
2019-01-16 04:47:25 [DEBUG   ] Got command BAM from MCS: ref #1182644
2019-01-16 04:47:25 [INFO    ] Finished processing BAM request
2019-01-16 04:47:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:47:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182644   8 58499 17245029 A  ERROR'
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 04:47:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 04:47:25 [DEBUG   ] spawn_process: at 2019-01-16 04:47:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 04:47:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 04:48:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 04:48:06 [DEBUG   ] Got command BAM from MCS: ref #1182650
2019-01-16 04:48:06 [INFO    ] Finished processing BAM request
2019-01-16 04:48:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:48:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182650   8 58499 17286025 A  ERROR'
2019-01-16 04:48:06 [DEBUG   ] Got command BAM from MCS: ref #1182651
2019-01-16 04:48:06 [INFO    ] Finished processing BAM request
2019-01-16 04:48:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:48:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182651   8 58499 17286029 A  ERROR'
2019-01-16 04:48:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-16 04:48:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 04:48:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:48:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2019-01-16 04:48:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:48:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:48:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:48:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:48:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:48:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:48:06 [DEBUG   ] Finished updating board flags in 1.001 seconds
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 04:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 04:48:06 [DEBUG   ] spawn_process: at 2019-01-16 04:48:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 04:48:21 [DEBUG   ] Finished updating ant stats in 0.787 seconds
2019-01-16 04:48:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:48:47 [DEBUG   ] Got command BAM from MCS: ref #1182652
2019-01-16 04:48:47 [INFO    ] Finished processing BAM request
2019-01-16 04:48:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:48:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182652   8 58499 17327029 A  ERROR'
2019-01-16 04:48:47 [DEBUG   ] Got command BAM from MCS: ref #1182653
2019-01-16 04:48:47 [INFO    ] Finished processing BAM request
2019-01-16 04:48:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:48:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182653   8 58499 17327033 A  ERROR'
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 04:48:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 04:48:47 [DEBUG   ] spawn_process: at 2019-01-16 04:48:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 04:49:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 04:49:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-16 04:49:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:49:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 04:49:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:49:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 04:49:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 04:49:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:49:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:49:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:49:06 [WARNING ] (13, 1, 'bot')
2019-01-16 04:49:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:49:06 [DEBUG   ] Finished updating board flags in 1.022 seconds
2019-01-16 04:49:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:49:28 [DEBUG   ] Got command BAM from MCS: ref #1182655
2019-01-16 04:49:28 [INFO    ] Finished processing BAM request
2019-01-16 04:49:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:49:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182655   8 58499 17368029 A  ERROR'
2019-01-16 04:49:28 [DEBUG   ] Got command BAM from MCS: ref #1182654
2019-01-16 04:49:28 [INFO    ] Finished processing BAM request
2019-01-16 04:49:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:49:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182654   8 58499 17368033 A  ERROR'
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 04:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 04:49:28 [DEBUG   ] spawn_process: at 2019-01-16 04:49:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 04:49:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 04:50:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 04:50:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:50:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:50:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:50:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:50:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:50:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:50:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:50:07 [DEBUG   ] Finished updating board flags in 1.574 seconds
2019-01-16 04:50:09 [DEBUG   ] Got command BAM from MCS: ref #1182656
2019-01-16 04:50:09 [INFO    ] Finished processing BAM request
2019-01-16 04:50:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:50:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182656   8 58499 17409033 A  ERROR'
2019-01-16 04:50:09 [DEBUG   ] Got command BAM from MCS: ref #1182657
2019-01-16 04:50:09 [INFO    ] Finished processing BAM request
2019-01-16 04:50:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:50:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182657   8 58499 17409037 A  ERROR'
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 04:50:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 04:50:09 [DEBUG   ] spawn_process: at 2019-01-16 04:50:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 04:50:21 [DEBUG   ] Finished updating ant stats in 0.587 seconds
2019-01-16 04:50:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 04:50:50 [DEBUG   ] Got command BAM from MCS: ref #1182662
2019-01-16 04:50:50 [INFO    ] Finished processing BAM request
2019-01-16 04:50:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:50:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182662   8 58499 17450033 A  ERROR'
2019-01-16 04:50:50 [DEBUG   ] Got command BAM from MCS: ref #1182663
2019-01-16 04:50:50 [INFO    ] Finished processing BAM request
2019-01-16 04:50:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:50:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182663   8 58499 17450037 A  ERROR'
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 04:50:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 04:50:50 [DEBUG   ] spawn_process: at 2019-01-16 04:50:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 04:51:01 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-16 04:51:05 [DEBUG   ] Got command RPT from MCS: ref #1182664
2019-01-16 04:51:05 [DEBUG   ] summary = ERROR
2019-01-16 04:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182664  13 58499 17465213 A  ERRORERROR'
2019-01-16 04:51:05 [DEBUG   ] Got command RPT from MCS: ref #1182665
2019-01-16 04:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182665  77 58499 17465214 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:51:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 04:51:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:51:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 04:51:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-16 04:51:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:51:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:51:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:51:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:51:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:51:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:51:07 [DEBUG   ] Finished updating board flags in 1.354 seconds
2019-01-16 04:51:21 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-16 04:51:31 [DEBUG   ] Got command BAM from MCS: ref #1182682
2019-01-16 04:51:31 [INFO    ] Finished processing BAM request
2019-01-16 04:51:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:51:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182682   8 58499 17491025 A  ERROR'
2019-01-16 04:51:31 [DEBUG   ] Got command BAM from MCS: ref #1182681
2019-01-16 04:51:31 [INFO    ] Finished processing BAM request
2019-01-16 04:51:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:51:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182681   8 58499 17491029 A  ERROR'
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 04:51:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 04:51:31 [DEBUG   ] spawn_process: at 2019-01-16 04:51:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 04:51:35 [DEBUG   ] Got command RPT from MCS: ref #1182683
2019-01-16 04:51:35 [DEBUG   ] summary = ERROR
2019-01-16 04:51:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182683  13 58499 17495493 A  ERRORERROR'
2019-01-16 04:51:35 [DEBUG   ] Got command RPT from MCS: ref #1182684
2019-01-16 04:51:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:51:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182684  77 58499 17495697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:51:35 [DEBUG   ] Got command RPT from MCS: ref #1182685
2019-01-16 04:51:35 [DEBUG   ] summary = ERROR
2019-01-16 04:51:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182685  13 58499 17495889 A  ERRORERROR'
2019-01-16 04:51:36 [DEBUG   ] Got command RPT from MCS: ref #1182686
2019-01-16 04:51:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:51:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182686  77 58499 17496093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:51:36 [DEBUG   ] Got command RPT from MCS: ref #1182687
2019-01-16 04:51:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 04:51:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182687  12 58499 17496297 A  ERRORB¢ff'
2019-01-16 04:51:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:52:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:52:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 04:52:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:52:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:52:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:52:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:52:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:52:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:52:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:52:07 [DEBUG   ] Finished updating board flags in 1.213 seconds
2019-01-16 04:52:12 [DEBUG   ] Got command BAM from MCS: ref #1182689
2019-01-16 04:52:12 [INFO    ] Finished processing BAM request
2019-01-16 04:52:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:52:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182689   8 58499 17532029 A  ERROR'
2019-01-16 04:52:12 [DEBUG   ] Got command BAM from MCS: ref #1182688
2019-01-16 04:52:12 [INFO    ] Finished processing BAM request
2019-01-16 04:52:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:52:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182688   8 58499 17532033 A  ERROR'
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 04:52:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 04:52:12 [DEBUG   ] spawn_process: at 2019-01-16 04:52:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 04:52:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:52:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:52:53 [DEBUG   ] Got command BAM from MCS: ref #1182690
2019-01-16 04:52:53 [INFO    ] Finished processing BAM request
2019-01-16 04:52:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:52:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182690   8 58499 17573033 A  ERROR'
2019-01-16 04:52:53 [DEBUG   ] Got command BAM from MCS: ref #1182691
2019-01-16 04:52:53 [INFO    ] Finished processing BAM request
2019-01-16 04:52:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:52:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182691   8 58499 17573037 A  ERROR'
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 04:52:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 04:52:53 [DEBUG   ] spawn_process: at 2019-01-16 04:52:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 04:53:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:53:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 04:53:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:53:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 04:53:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:53:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:53:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:53:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:53:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:53:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:53:07 [DEBUG   ] Finished updating board flags in 1.191 seconds
2019-01-16 04:53:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:53:34 [DEBUG   ] Got command BAM from MCS: ref #1182692
2019-01-16 04:53:34 [INFO    ] Finished processing BAM request
2019-01-16 04:53:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:53:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182692   8 58499 17614033 A  ERROR'
2019-01-16 04:53:34 [DEBUG   ] Got command BAM from MCS: ref #1182693
2019-01-16 04:53:34 [INFO    ] Finished processing BAM request
2019-01-16 04:53:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:53:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182693   8 58499 17614037 A  ERROR'
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 04:53:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 04:53:34 [DEBUG   ] spawn_process: at 2019-01-16 04:53:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 04:53:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:54:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 04:54:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:54:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:54:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 04:54:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:54:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:54:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:54:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:54:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:54:07 [DEBUG   ] Finished updating board flags in 1.049 seconds
2019-01-16 04:54:15 [DEBUG   ] Got command BAM from MCS: ref #1182699
2019-01-16 04:54:15 [INFO    ] Finished processing BAM request
2019-01-16 04:54:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:54:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182699   8 58499 17655033 A  ERROR'
2019-01-16 04:54:15 [DEBUG   ] Got command BAM from MCS: ref #1182698
2019-01-16 04:54:15 [INFO    ] Finished processing BAM request
2019-01-16 04:54:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:54:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182698   8 58499 17655037 A  ERROR'
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 04:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 04:54:15 [DEBUG   ] spawn_process: at 2019-01-16 04:54:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 04:54:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:54:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:54:56 [DEBUG   ] Got command BAM from MCS: ref #1182700
2019-01-16 04:54:56 [INFO    ] Finished processing BAM request
2019-01-16 04:54:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:54:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182700   8 58499 17696025 A  ERROR'
2019-01-16 04:54:56 [DEBUG   ] Got command BAM from MCS: ref #1182701
2019-01-16 04:54:56 [INFO    ] Finished processing BAM request
2019-01-16 04:54:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:54:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182701   8 58499 17696029 A  ERROR'
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 04:54:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 04:54:56 [DEBUG   ] spawn_process: at 2019-01-16 04:54:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 04:55:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 04:55:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:55:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-16 04:55:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:55:08 [WARNING ] (13, 1, 'bot')
2019-01-16 04:55:08 [WARNING ] (13, 1, 'bot')
2019-01-16 04:55:08 [WARNING ] (13, 1, 'bot')
2019-01-16 04:55:08 [WARNING ] (13, 1, 'bot')
2019-01-16 04:55:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:55:08 [DEBUG   ] Finished updating board flags in 1.977 seconds
2019-01-16 04:55:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:55:37 [DEBUG   ] Got command BAM from MCS: ref #1182702
2019-01-16 04:55:37 [INFO    ] Finished processing BAM request
2019-01-16 04:55:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182702   8 58499 17737025 A  ERROR'
2019-01-16 04:55:37 [DEBUG   ] Got command BAM from MCS: ref #1182703
2019-01-16 04:55:37 [INFO    ] Finished processing BAM request
2019-01-16 04:55:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:55:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182703   8 58499 17737029 A  ERROR'
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 04:55:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 04:55:37 [DEBUG   ] spawn_process: at 2019-01-16 04:55:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 04:55:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:56:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 04:56:05 [DEBUG   ] Got command RPT from MCS: ref #1182704
2019-01-16 04:56:05 [DEBUG   ] summary = ERROR
2019-01-16 04:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182704  13 58499 17765221 A  ERRORERROR'
2019-01-16 04:56:05 [DEBUG   ] Got command RPT from MCS: ref #1182705
2019-01-16 04:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182705  77 58499 17765222 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:56:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 04:56:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:56:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:56:08 [WARNING ] (13, 1, 'bot')
2019-01-16 04:56:08 [WARNING ] (13, 1, 'bot')
2019-01-16 04:56:08 [WARNING ] (13, 1, 'bot')
2019-01-16 04:56:08 [WARNING ] (13, 1, 'bot')
2019-01-16 04:56:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:56:08 [DEBUG   ] Finished updating board flags in 1.779 seconds
2019-01-16 04:56:18 [DEBUG   ] Got command BAM from MCS: ref #1182721
2019-01-16 04:56:18 [INFO    ] Finished processing BAM request
2019-01-16 04:56:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:56:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182721   8 58499 17778025 A  ERROR'
2019-01-16 04:56:18 [DEBUG   ] Got command BAM from MCS: ref #1182722
2019-01-16 04:56:18 [INFO    ] Finished processing BAM request
2019-01-16 04:56:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:56:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182722   8 58499 17778029 A  ERROR'
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 04:56:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 04:56:18 [DEBUG   ] spawn_process: at 2019-01-16 04:56:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 04:56:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:56:35 [DEBUG   ] Got command RPT from MCS: ref #1182725
2019-01-16 04:56:35 [DEBUG   ] summary = ERROR
2019-01-16 04:56:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182725  13 58499 17795573 A  ERRORERROR'
2019-01-16 04:56:35 [DEBUG   ] Got command RPT from MCS: ref #1182726
2019-01-16 04:56:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:56:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182726  77 58499 17795777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:56:35 [DEBUG   ] Got command RPT from MCS: ref #1182727
2019-01-16 04:56:35 [DEBUG   ] summary = ERROR
2019-01-16 04:56:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182727  13 58499 17795981 A  ERRORERROR'
2019-01-16 04:56:36 [DEBUG   ] Got command RPT from MCS: ref #1182729
2019-01-16 04:56:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 04:56:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182729  77 58499 17796173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 04:56:36 [DEBUG   ] Got command RPT from MCS: ref #1182731
2019-01-16 04:56:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 04:56:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182731  12 58499 17796377 A  ERRORB¢ff'
2019-01-16 04:56:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 04:56:59 [DEBUG   ] Got command BAM from MCS: ref #1182739
2019-01-16 04:56:59 [INFO    ] Finished processing BAM request
2019-01-16 04:56:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:56:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182739   8 58499 17819029 A  ERROR'
2019-01-16 04:56:59 [DEBUG   ] Got command BAM from MCS: ref #1182740
2019-01-16 04:56:59 [INFO    ] Finished processing BAM request
2019-01-16 04:56:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:56:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182740   8 58499 17819033 A  ERROR'
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 04:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 04:56:59 [DEBUG   ] spawn_process: at 2019-01-16 04:56:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 04:57:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 04:57:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-16 04:57:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2019-01-16 04:57:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:57:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:57:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 04:57:08 [WARNING ] (13, 1, 'bot')
2019-01-16 04:57:08 [WARNING ] (13, 1, 'bot')
2019-01-16 04:57:08 [WARNING ] (13, 1, 'bot')
2019-01-16 04:57:08 [WARNING ] (13, 1, 'bot')
2019-01-16 04:57:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:57:08 [DEBUG   ] Finished updating board flags in 1.686 seconds
2019-01-16 04:57:22 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-16 04:57:40 [DEBUG   ] Got command BAM from MCS: ref #1182741
2019-01-16 04:57:40 [INFO    ] Finished processing BAM request
2019-01-16 04:57:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182741   8 58499 17860033 A  ERROR'
2019-01-16 04:57:40 [DEBUG   ] Got command BAM from MCS: ref #1182742
2019-01-16 04:57:40 [INFO    ] Finished processing BAM request
2019-01-16 04:57:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182742   8 58499 17860037 A  ERROR'
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 04:57:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 04:57:40 [DEBUG   ] spawn_process: at 2019-01-16 04:57:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 04:57:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 04:58:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 04:58:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-16 04:58:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:58:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 04:58:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:58:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:58:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:58:07 [WARNING ] (13, 1, 'bot')
2019-01-16 04:58:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:58:07 [DEBUG   ] Finished updating board flags in 0.969 seconds
2019-01-16 04:58:21 [DEBUG   ] Got command BAM from MCS: ref #1182743
2019-01-16 04:58:21 [INFO    ] Finished processing BAM request
2019-01-16 04:58:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182743   8 58499 17901033 A  ERROR'
2019-01-16 04:58:21 [DEBUG   ] Got command BAM from MCS: ref #1182744
2019-01-16 04:58:21 [INFO    ] Finished processing BAM request
2019-01-16 04:58:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182744   8 58499 17901037 A  ERROR'
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 04:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 04:58:21 [DEBUG   ] spawn_process: at 2019-01-16 04:58:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 04:58:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 04:58:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 04:59:02 [DEBUG   ] Got command BAM from MCS: ref #1182746
2019-01-16 04:59:02 [INFO    ] Finished processing BAM request
2019-01-16 04:59:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:59:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182746   8 58499 17942029 A  ERROR'
2019-01-16 04:59:02 [DEBUG   ] Got command BAM from MCS: ref #1182745
2019-01-16 04:59:02 [INFO    ] Finished processing BAM request
2019-01-16 04:59:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:59:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182745   8 58499 17942033 A  ERROR'
2019-01-16 04:59:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 04:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 04:59:02 [DEBUG   ] spawn_process: at 2019-01-16 04:59:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 04:59:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 04:59:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 04:59:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 04:59:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-16 04:59:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 04:59:08 [WARNING ] (13, 1, 'bot')
2019-01-16 04:59:08 [WARNING ] (13, 1, 'bot')
2019-01-16 04:59:08 [WARNING ] (13, 1, 'bot')
2019-01-16 04:59:08 [WARNING ] (13, 1, 'bot')
2019-01-16 04:59:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 04:59:08 [DEBUG   ] Finished updating board flags in 1.347 seconds
2019-01-16 04:59:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 04:59:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 04:59:43 [DEBUG   ] Got command BAM from MCS: ref #1182748
2019-01-16 04:59:43 [INFO    ] Finished processing BAM request
2019-01-16 04:59:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:59:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182748   8 58499 17983033 A  ERROR'
2019-01-16 04:59:43 [DEBUG   ] Got command BAM from MCS: ref #1182749
2019-01-16 04:59:43 [INFO    ] Finished processing BAM request
2019-01-16 04:59:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 04:59:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182749   8 58499 17983037 A  ERROR'
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 04:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 04:59:43 [DEBUG   ] spawn_process: at 2019-01-16 04:59:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 05:00:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 05:00:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:00:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 05:00:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-16 05:00:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:00:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:00:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:00:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:00:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:00:08 [DEBUG   ] Finished updating board flags in 1.211 seconds
2019-01-16 05:00:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 05:00:24 [DEBUG   ] Got command BAM from MCS: ref #1182754
2019-01-16 05:00:24 [INFO    ] Finished processing BAM request
2019-01-16 05:00:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:00:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182754   8 58499 18024033 A  ERROR'
2019-01-16 05:00:24 [DEBUG   ] Got command BAM from MCS: ref #1182753
2019-01-16 05:00:24 [INFO    ] Finished processing BAM request
2019-01-16 05:00:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:00:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182753   8 58499 18024037 A  ERROR'
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 05:00:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 05:00:24 [DEBUG   ] spawn_process: at 2019-01-16 05:00:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 05:00:42 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-16 05:01:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 05:01:05 [DEBUG   ] Got command BAM from MCS: ref #1182756
2019-01-16 05:01:05 [INFO    ] Finished processing BAM request
2019-01-16 05:01:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182756   8 58499 18065033 A  ERROR'
2019-01-16 05:01:05 [DEBUG   ] Got command BAM from MCS: ref #1182755
2019-01-16 05:01:05 [INFO    ] Finished processing BAM request
2019-01-16 05:01:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182755   8 58499 18065037 A  ERROR'
2019-01-16 05:01:05 [DEBUG   ] Got command RPT from MCS: ref #1182757
2019-01-16 05:01:05 [DEBUG   ] summary = ERROR
2019-01-16 05:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182757  13 58499 18065217 A  ERRORERROR'
2019-01-16 05:01:05 [DEBUG   ] Got command RPT from MCS: ref #1182758
2019-01-16 05:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182758  77 58499 18065218 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 05:01:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 05:01:05 [DEBUG   ] spawn_process: at 2019-01-16 05:01:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 05:01:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-16 05:01:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 05:01:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:01:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 05:01:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 05:01:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 05:01:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:01:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:01:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:01:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:01:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:01:08 [DEBUG   ] Finished updating board flags in 1.209 seconds
2019-01-16 05:01:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-16 05:01:35 [DEBUG   ] Got command RPT from MCS: ref #1182774
2019-01-16 05:01:35 [DEBUG   ] summary = ERROR
2019-01-16 05:01:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182774  13 58499 18095661 A  ERRORERROR'
2019-01-16 05:01:35 [DEBUG   ] Got command RPT from MCS: ref #1182775
2019-01-16 05:01:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:01:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182775  77 58499 18095865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:01:36 [DEBUG   ] Got command RPT from MCS: ref #1182776
2019-01-16 05:01:36 [DEBUG   ] summary = ERROR
2019-01-16 05:01:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182776  13 58499 18096057 A  ERRORERROR'
2019-01-16 05:01:36 [DEBUG   ] Got command RPT from MCS: ref #1182777
2019-01-16 05:01:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:01:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182777  77 58499 18096261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:01:36 [DEBUG   ] Got command RPT from MCS: ref #1182778
2019-01-16 05:01:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 05:01:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182778  12 58499 18096466 A  ERRORB¢ff'
2019-01-16 05:01:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 05:01:46 [DEBUG   ] Got command BAM from MCS: ref #1182780
2019-01-16 05:01:46 [INFO    ] Finished processing BAM request
2019-01-16 05:01:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:01:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182780   8 58499 18106033 A  ERROR'
2019-01-16 05:01:46 [DEBUG   ] Got command BAM from MCS: ref #1182779
2019-01-16 05:01:46 [INFO    ] Finished processing BAM request
2019-01-16 05:01:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:01:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182779   8 58499 18106037 A  ERROR'
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 05:01:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 05:01:46 [DEBUG   ] spawn_process: at 2019-01-16 05:01:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 05:02:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 05:02:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:02:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-16 05:02:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 05:02:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:02:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:02:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:02:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:02:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:02:08 [DEBUG   ] Finished updating board flags in 1.193 seconds
2019-01-16 05:02:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 05:02:27 [DEBUG   ] Got command BAM from MCS: ref #1182781
2019-01-16 05:02:27 [INFO    ] Finished processing BAM request
2019-01-16 05:02:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:02:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182781   8 58499 18147025 A  ERROR'
2019-01-16 05:02:27 [DEBUG   ] Got command BAM from MCS: ref #1182782
2019-01-16 05:02:27 [INFO    ] Finished processing BAM request
2019-01-16 05:02:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:02:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182782   8 58499 18147029 A  ERROR'
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 05:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 05:02:27 [DEBUG   ] spawn_process: at 2019-01-16 05:02:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 05:02:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 05:03:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 05:03:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:03:08 [DEBUG   ] Got command BAM from MCS: ref #1182787
2019-01-16 05:03:08 [INFO    ] Finished processing BAM request
2019-01-16 05:03:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:03:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182787   8 58499 18188029 A  ERROR'
2019-01-16 05:03:08 [DEBUG   ] Got command BAM from MCS: ref #1182788
2019-01-16 05:03:08 [INFO    ] Finished processing BAM request
2019-01-16 05:03:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:03:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182788   8 58499 18188033 A  ERROR'
2019-01-16 05:03:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 05:03:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-16 05:03:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:03:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:03:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:03:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:03:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:03:08 [DEBUG   ] Finished updating board flags in 1.005 seconds
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 05:03:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 05:03:08 [DEBUG   ] spawn_process: at 2019-01-16 05:03:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 05:03:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 05:03:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 05:03:49 [DEBUG   ] Got command BAM from MCS: ref #1182789
2019-01-16 05:03:49 [INFO    ] Finished processing BAM request
2019-01-16 05:03:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:03:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182789   8 58499 18229033 A  ERROR'
2019-01-16 05:03:49 [DEBUG   ] Got command BAM from MCS: ref #1182790
2019-01-16 05:03:49 [INFO    ] Finished processing BAM request
2019-01-16 05:03:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:03:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182790   8 58499 18229037 A  ERROR'
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 05:03:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 05:03:49 [DEBUG   ] spawn_process: at 2019-01-16 05:03:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 05:04:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 05:04:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 05:04:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-16 05:04:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:04:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 05:04:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:04:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:04:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:04:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:04:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:04:08 [DEBUG   ] Finished updating board flags in 1.070 seconds
2019-01-16 05:04:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 05:04:30 [DEBUG   ] Got command BAM from MCS: ref #1182792
2019-01-16 05:04:30 [INFO    ] Finished processing BAM request
2019-01-16 05:04:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:04:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182792   8 58499 18270029 A  ERROR'
2019-01-16 05:04:30 [DEBUG   ] Got command BAM from MCS: ref #1182791
2019-01-16 05:04:30 [INFO    ] Finished processing BAM request
2019-01-16 05:04:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:04:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182791   8 58499 18270033 A  ERROR'
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 05:04:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 05:04:30 [DEBUG   ] spawn_process: at 2019-01-16 05:04:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 05:04:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 05:05:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 05:05:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 05:05:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-16 05:05:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:05:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 05:05:09 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 05:05:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 05:05:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:05:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:05:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:05:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:05:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:05:09 [DEBUG   ] Finished updating board flags in 2.014 seconds
2019-01-16 05:05:11 [DEBUG   ] Got command BAM from MCS: ref #1182793
2019-01-16 05:05:11 [INFO    ] Finished processing BAM request
2019-01-16 05:05:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:05:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182793   8 58499 18311033 A  ERROR'
2019-01-16 05:05:11 [DEBUG   ] Got command BAM from MCS: ref #1182794
2019-01-16 05:05:11 [INFO    ] Finished processing BAM request
2019-01-16 05:05:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:05:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182794   8 58499 18311037 A  ERROR'
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 05:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 05:05:11 [DEBUG   ] spawn_process: at 2019-01-16 05:05:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 05:05:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-16 05:05:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 05:05:52 [DEBUG   ] Got command BAM from MCS: ref #1182800
2019-01-16 05:05:52 [INFO    ] Finished processing BAM request
2019-01-16 05:05:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:05:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182800   8 58499 18352025 A  ERROR'
2019-01-16 05:05:52 [DEBUG   ] Got command BAM from MCS: ref #1182799
2019-01-16 05:05:52 [INFO    ] Finished processing BAM request
2019-01-16 05:05:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:05:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182799   8 58499 18352029 A  ERROR'
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 05:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 05:05:52 [DEBUG   ] spawn_process: at 2019-01-16 05:05:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 05:06:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 05:06:05 [DEBUG   ] Got command RPT from MCS: ref #1182801
2019-01-16 05:06:05 [DEBUG   ] summary = ERROR
2019-01-16 05:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182801  13 58499 18365217 A  ERRORERROR'
2019-01-16 05:06:05 [DEBUG   ] Got command RPT from MCS: ref #1182802
2019-01-16 05:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182802  77 58499 18365218 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:06:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 05:06:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:06:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 05:06:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:06:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:06:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:06:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:06:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:06:08 [DEBUG   ] Finished updating board flags in 1.357 seconds
2019-01-16 05:06:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 05:06:34 [DEBUG   ] Got command BAM from MCS: ref #1182820
2019-01-16 05:06:34 [INFO    ] Finished processing BAM request
2019-01-16 05:06:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:06:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182820   8 58499 18394033 A  ERROR'
2019-01-16 05:06:34 [DEBUG   ] Got command BAM from MCS: ref #1182821
2019-01-16 05:06:34 [INFO    ] Finished processing BAM request
2019-01-16 05:06:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:06:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182821   8 58499 18394037 A  ERROR'
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 05:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 05:06:34 [DEBUG   ] spawn_process: at 2019-01-16 05:06:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 05:06:35 [DEBUG   ] Got command RPT from MCS: ref #1182822
2019-01-16 05:06:35 [DEBUG   ] summary = ERROR
2019-01-16 05:06:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182822  13 58499 18395741 A  ERRORERROR'
2019-01-16 05:06:35 [DEBUG   ] Got command RPT from MCS: ref #1182823
2019-01-16 05:06:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:06:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182823  77 58499 18395945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:06:36 [DEBUG   ] Got command RPT from MCS: ref #1182824
2019-01-16 05:06:36 [DEBUG   ] summary = ERROR
2019-01-16 05:06:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182824  13 58499 18396149 A  ERRORERROR'
2019-01-16 05:06:36 [DEBUG   ] Got command RPT from MCS: ref #1182826
2019-01-16 05:06:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:06:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182826  77 58499 18396341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:06:36 [DEBUG   ] Got command RPT from MCS: ref #1182827
2019-01-16 05:06:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 05:06:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182827  12 58499 18396545 A  ERRORB£ff'
2019-01-16 05:06:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 05:07:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 05:07:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 05:07:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:07:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 05:07:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:07:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:07:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:07:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:07:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:07:08 [DEBUG   ] Finished updating board flags in 1.215 seconds
2019-01-16 05:07:16 [DEBUG   ] Got command BAM from MCS: ref #1182833
2019-01-16 05:07:16 [INFO    ] Finished processing BAM request
2019-01-16 05:07:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:07:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182833   8 58499 18436033 A  ERROR'
2019-01-16 05:07:16 [DEBUG   ] Got command BAM from MCS: ref #1182832
2019-01-16 05:07:16 [INFO    ] Finished processing BAM request
2019-01-16 05:07:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:07:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182832   8 58499 18436037 A  ERROR'
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 05:07:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 05:07:16 [DEBUG   ] spawn_process: at 2019-01-16 05:07:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 05:07:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 05:07:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 05:07:58 [DEBUG   ] Got command BAM from MCS: ref #1182835
2019-01-16 05:07:58 [INFO    ] Finished processing BAM request
2019-01-16 05:07:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:07:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182835   8 58499 18478025 A  ERROR'
2019-01-16 05:07:58 [DEBUG   ] Got command BAM from MCS: ref #1182834
2019-01-16 05:07:58 [INFO    ] Finished processing BAM request
2019-01-16 05:07:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:07:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182834   8 58499 18478029 A  ERROR'
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 05:07:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 05:07:58 [DEBUG   ] spawn_process: at 2019-01-16 05:07:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 05:08:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 05:08:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:08:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 05:08:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 05:08:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 05:08:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:08:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:08:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:08:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:08:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:08:08 [DEBUG   ] Finished updating board flags in 1.203 seconds
2019-01-16 05:08:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 05:08:40 [DEBUG   ] Got command BAM from MCS: ref #1182836
2019-01-16 05:08:40 [INFO    ] Finished processing BAM request
2019-01-16 05:08:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:08:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182836   8 58499 18520029 A  ERROR'
2019-01-16 05:08:40 [DEBUG   ] Got command BAM from MCS: ref #1182837
2019-01-16 05:08:40 [INFO    ] Finished processing BAM request
2019-01-16 05:08:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:08:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182837   8 58499 18520033 A  ERROR'
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 05:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 05:08:40 [DEBUG   ] spawn_process: at 2019-01-16 05:08:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 05:08:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 05:09:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 05:09:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 05:09:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:09:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 05:09:08 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-16 05:09:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 05:09:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:09:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:09:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:09:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:09:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:09:08 [DEBUG   ] Finished updating board flags in 1.231 seconds
2019-01-16 05:09:22 [DEBUG   ] Got command BAM from MCS: ref #1182843
2019-01-16 05:09:22 [INFO    ] Finished processing BAM request
2019-01-16 05:09:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:09:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182843   8 58499 18562033 A  ERROR'
2019-01-16 05:09:22 [DEBUG   ] Got command BAM from MCS: ref #1182842
2019-01-16 05:09:22 [INFO    ] Finished processing BAM request
2019-01-16 05:09:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:09:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182842   8 58499 18562037 A  ERROR'
2019-01-16 05:09:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 05:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 05:09:22 [DEBUG   ] spawn_process: at 2019-01-16 05:09:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 05:09:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 05:10:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 05:10:04 [DEBUG   ] Got command BAM from MCS: ref #1182845
2019-01-16 05:10:04 [INFO    ] Finished processing BAM request
2019-01-16 05:10:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:10:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182845   8 58499 18604029 A  ERROR'
2019-01-16 05:10:04 [DEBUG   ] Got command BAM from MCS: ref #1182844
2019-01-16 05:10:04 [INFO    ] Finished processing BAM request
2019-01-16 05:10:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:10:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182844   8 58499 18604033 A  ERROR'
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 05:10:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 05:10:04 [DEBUG   ] spawn_process: at 2019-01-16 05:10:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 05:10:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-01-16 05:10:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 05:10:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:10:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-01-16 05:10:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 05:10:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:10:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:10:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:10:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:10:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:10:08 [DEBUG   ] Finished updating board flags in 1.150 seconds
2019-01-16 05:10:22 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-16 05:10:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 05:10:46 [DEBUG   ] Got command BAM from MCS: ref #1182847
2019-01-16 05:10:46 [INFO    ] Finished processing BAM request
2019-01-16 05:10:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:10:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182847   8 58499 18646033 A  ERROR'
2019-01-16 05:10:46 [DEBUG   ] Got command BAM from MCS: ref #1182846
2019-01-16 05:10:46 [INFO    ] Finished processing BAM request
2019-01-16 05:10:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:10:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182846   8 58499 18646037 A  ERROR'
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 05:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 05:10:46 [DEBUG   ] spawn_process: at 2019-01-16 05:10:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 05:11:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 05:11:05 [DEBUG   ] Got command RPT from MCS: ref #1182848
2019-01-16 05:11:05 [DEBUG   ] summary = ERROR
2019-01-16 05:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182848  13 58499 18665221 A  ERRORERROR'
2019-01-16 05:11:05 [DEBUG   ] Got command RPT from MCS: ref #1182849
2019-01-16 05:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182849  77 58499 18665222 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:11:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 05:11:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:11:09 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 05:11:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:11:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:11:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:11:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:11:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:11:09 [DEBUG   ] Finished updating board flags in 1.635 seconds
2019-01-16 05:11:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-16 05:11:28 [DEBUG   ] Got command BAM from MCS: ref #1182866
2019-01-16 05:11:28 [INFO    ] Finished processing BAM request
2019-01-16 05:11:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:11:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182866   8 58499 18688029 A  ERROR'
2019-01-16 05:11:28 [DEBUG   ] Got command BAM from MCS: ref #1182865
2019-01-16 05:11:28 [INFO    ] Finished processing BAM request
2019-01-16 05:11:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:11:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182865   8 58499 18688033 A  ERROR'
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 05:11:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 05:11:28 [DEBUG   ] spawn_process: at 2019-01-16 05:11:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 05:11:35 [DEBUG   ] Got command RPT from MCS: ref #1182867
2019-01-16 05:11:35 [DEBUG   ] summary = ERROR
2019-01-16 05:11:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182867  13 58499 18695833 A  ERRORERROR'
2019-01-16 05:11:36 [DEBUG   ] Got command RPT from MCS: ref #1182868
2019-01-16 05:11:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:11:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182868  77 58499 18696025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:11:36 [DEBUG   ] Got command RPT from MCS: ref #1182869
2019-01-16 05:11:36 [DEBUG   ] summary = ERROR
2019-01-16 05:11:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182869  13 58499 18696229 A  ERRORERROR'
2019-01-16 05:11:36 [DEBUG   ] Got command RPT from MCS: ref #1182870
2019-01-16 05:11:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:11:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182870  77 58499 18696433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:11:36 [DEBUG   ] Got command RPT from MCS: ref #1182871
2019-01-16 05:11:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 05:11:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182871  12 58499 18696637 A  ERRORB¢ff'
2019-01-16 05:11:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 05:12:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 05:12:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 05:12:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 05:12:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:12:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 05:12:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:12:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:12:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:12:08 [WARNING ] (13, 1, 'bot')
2019-01-16 05:12:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:12:08 [DEBUG   ] Finished updating board flags in 0.987 seconds
2019-01-16 05:12:10 [DEBUG   ] Got command BAM from MCS: ref #1182877
2019-01-16 05:12:10 [INFO    ] Finished processing BAM request
2019-01-16 05:12:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:12:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182877   8 58499 18730033 A  ERROR'
2019-01-16 05:12:10 [DEBUG   ] Got command BAM from MCS: ref #1182876
2019-01-16 05:12:10 [INFO    ] Finished processing BAM request
2019-01-16 05:12:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:12:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182876   8 58499 18730037 A  ERROR'
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 05:12:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 05:12:10 [DEBUG   ] spawn_process: at 2019-01-16 05:12:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 05:12:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 05:12:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 05:12:52 [DEBUG   ] Got command BAM from MCS: ref #1182879
2019-01-16 05:12:52 [INFO    ] Finished processing BAM request
2019-01-16 05:12:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:12:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182879   8 58499 18772029 A  ERROR'
2019-01-16 05:12:52 [DEBUG   ] Got command BAM from MCS: ref #1182878
2019-01-16 05:12:52 [INFO    ] Finished processing BAM request
2019-01-16 05:12:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:12:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182878   8 58499 18772033 A  ERROR'
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 05:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 05:12:52 [DEBUG   ] spawn_process: at 2019-01-16 05:12:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 05:13:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 05:13:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-16 05:13:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 05:13:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:13:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 05:13:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-16 05:13:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 05:13:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:13:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:13:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:13:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:13:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:13:09 [DEBUG   ] Finished updating board flags in 1.366 seconds
2019-01-16 05:13:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 05:13:34 [DEBUG   ] Got command BAM from MCS: ref #1182880
2019-01-16 05:13:34 [INFO    ] Finished processing BAM request
2019-01-16 05:13:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:13:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182880   8 58499 18814033 A  ERROR'
2019-01-16 05:13:34 [DEBUG   ] Got command BAM from MCS: ref #1182881
2019-01-16 05:13:34 [INFO    ] Finished processing BAM request
2019-01-16 05:13:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:13:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182881   8 58499 18814037 A  ERROR'
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 05:13:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 05:13:34 [DEBUG   ] spawn_process: at 2019-01-16 05:13:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 05:13:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 05:14:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 05:14:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:14:09 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-16 05:14:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:14:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:14:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:14:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:14:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:14:09 [DEBUG   ] Finished updating board flags in 1.196 seconds
2019-01-16 05:14:16 [DEBUG   ] Got command BAM from MCS: ref #1182883
2019-01-16 05:14:16 [INFO    ] Finished processing BAM request
2019-01-16 05:14:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:14:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182883   8 58499 18856033 A  ERROR'
2019-01-16 05:14:16 [DEBUG   ] Got command BAM from MCS: ref #1182882
2019-01-16 05:14:16 [INFO    ] Finished processing BAM request
2019-01-16 05:14:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:14:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182882   8 58499 18856037 A  ERROR'
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 05:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 05:14:16 [DEBUG   ] spawn_process: at 2019-01-16 05:14:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 05:14:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-16 05:14:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-16 05:14:58 [DEBUG   ] Got command BAM from MCS: ref #1182888
2019-01-16 05:14:58 [INFO    ] Finished processing BAM request
2019-01-16 05:14:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182888   8 58499 18898029 A  ERROR'
2019-01-16 05:14:58 [DEBUG   ] Got command BAM from MCS: ref #1182889
2019-01-16 05:14:58 [INFO    ] Finished processing BAM request
2019-01-16 05:14:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182889   8 58499 18898033 A  ERROR'
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 05:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 05:14:58 [DEBUG   ] spawn_process: at 2019-01-16 05:14:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 05:15:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 05:15:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 05:15:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:15:09 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 05:15:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:15:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:15:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:15:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:15:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:15:09 [DEBUG   ] Finished updating board flags in 0.990 seconds
2019-01-16 05:15:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 05:15:40 [DEBUG   ] Got command BAM from MCS: ref #1182891
2019-01-16 05:15:40 [INFO    ] Finished processing BAM request
2019-01-16 05:15:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182891   8 58499 18940029 A  ERROR'
2019-01-16 05:15:40 [DEBUG   ] Got command BAM from MCS: ref #1182890
2019-01-16 05:15:40 [INFO    ] Finished processing BAM request
2019-01-16 05:15:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182890   8 58499 18940033 A  ERROR'
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 05:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 05:15:40 [DEBUG   ] spawn_process: at 2019-01-16 05:15:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 05:15:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 05:16:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 05:16:05 [DEBUG   ] Got command RPT from MCS: ref #1182892
2019-01-16 05:16:05 [DEBUG   ] summary = ERROR
2019-01-16 05:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182892  13 58499 18965221 A  ERRORERROR'
2019-01-16 05:16:05 [DEBUG   ] Got command RPT from MCS: ref #1182893
2019-01-16 05:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182893  77 58499 18965222 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:16:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 05:16:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:16:09 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 05:16:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:16:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:16:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:16:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:16:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:16:09 [DEBUG   ] Finished updating board flags in 1.264 seconds
2019-01-16 05:16:22 [DEBUG   ] Got command BAM from MCS: ref #1182910
2019-01-16 05:16:22 [INFO    ] Finished processing BAM request
2019-01-16 05:16:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:16:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182910   8 58499 18982029 A  ERROR'
2019-01-16 05:16:22 [DEBUG   ] Got command BAM from MCS: ref #1182909
2019-01-16 05:16:22 [INFO    ] Finished processing BAM request
2019-01-16 05:16:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:16:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182909   8 58499 18982033 A  ERROR'
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 05:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 05:16:22 [DEBUG   ] spawn_process: at 2019-01-16 05:16:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 05:16:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 05:16:35 [DEBUG   ] Got command RPT from MCS: ref #1182913
2019-01-16 05:16:35 [DEBUG   ] summary = ERROR
2019-01-16 05:16:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182913  13 58499 18995917 A  ERRORERROR'
2019-01-16 05:16:36 [DEBUG   ] Got command RPT from MCS: ref #1182914
2019-01-16 05:16:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:16:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182914  77 58499 18996109 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:16:36 [DEBUG   ] Got command RPT from MCS: ref #1182915
2019-01-16 05:16:36 [DEBUG   ] summary = ERROR
2019-01-16 05:16:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182915  13 58499 18996313 A  ERRORERROR'
2019-01-16 05:16:36 [DEBUG   ] Got command RPT from MCS: ref #1182917
2019-01-16 05:16:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:16:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182917  77 58499 18996517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:16:36 [DEBUG   ] Got command RPT from MCS: ref #1182918
2019-01-16 05:16:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 05:16:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182918  12 58499 18996721 A  ERRORB¢ff'
2019-01-16 05:16:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 05:17:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 05:17:04 [DEBUG   ] Got command BAM from MCS: ref #1182923
2019-01-16 05:17:04 [INFO    ] Finished processing BAM request
2019-01-16 05:17:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:17:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182923   8 58499 19024029 A  ERROR'
2019-01-16 05:17:04 [DEBUG   ] Got command BAM from MCS: ref #1182924
2019-01-16 05:17:04 [INFO    ] Finished processing BAM request
2019-01-16 05:17:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:17:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182924   8 58499 19024033 A  ERROR'
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 05:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 05:17:04 [DEBUG   ] spawn_process: at 2019-01-16 05:17:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 05:17:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:17:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 05:17:09 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 05:17:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 05:17:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:17:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:17:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:17:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:17:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:17:09 [DEBUG   ] Finished updating board flags in 1.182 seconds
2019-01-16 05:17:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-16 05:17:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 05:17:46 [DEBUG   ] Got command BAM from MCS: ref #1182930
2019-01-16 05:17:46 [INFO    ] Finished processing BAM request
2019-01-16 05:17:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:17:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182930   8 58499 19066033 A  ERROR'
2019-01-16 05:17:46 [DEBUG   ] Got command BAM from MCS: ref #1182929
2019-01-16 05:17:46 [INFO    ] Finished processing BAM request
2019-01-16 05:17:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:17:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182929   8 58499 19066037 A  ERROR'
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 05:17:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 05:17:46 [DEBUG   ] spawn_process: at 2019-01-16 05:17:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 05:18:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 05:18:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:18:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 05:18:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-01-16 05:18:09 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 05:18:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:18:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:18:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:18:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:18:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:18:09 [DEBUG   ] Finished updating board flags in 1.026 seconds
2019-01-16 05:18:23 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-01-16 05:18:28 [DEBUG   ] Got command BAM from MCS: ref #1182931
2019-01-16 05:18:28 [INFO    ] Finished processing BAM request
2019-01-16 05:18:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182931   8 58499 19108029 A  ERROR'
2019-01-16 05:18:28 [DEBUG   ] Got command BAM from MCS: ref #1182932
2019-01-16 05:18:28 [INFO    ] Finished processing BAM request
2019-01-16 05:18:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182932   8 58499 19108033 A  ERROR'
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 05:18:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 05:18:28 [DEBUG   ] spawn_process: at 2019-01-16 05:18:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 05:18:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 05:19:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 05:19:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-16 05:19:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-16 05:19:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:19:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-16 05:19:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 05:19:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:19:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:19:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:19:09 [WARNING ] (13, 1, 'bot')
2019-01-16 05:19:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:19:09 [DEBUG   ] Finished updating board flags in 1.010 seconds
2019-01-16 05:19:10 [DEBUG   ] Got command BAM from MCS: ref #1182933
2019-01-16 05:19:10 [INFO    ] Finished processing BAM request
2019-01-16 05:19:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:19:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182933   8 58499 19150033 A  ERROR'
2019-01-16 05:19:10 [DEBUG   ] Got command BAM from MCS: ref #1182934
2019-01-16 05:19:10 [INFO    ] Finished processing BAM request
2019-01-16 05:19:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:19:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182934   8 58499 19150037 A  ERROR'
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 05:19:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 05:19:10 [DEBUG   ] spawn_process: at 2019-01-16 05:19:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 05:19:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 05:19:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 05:19:52 [DEBUG   ] Got command BAM from MCS: ref #1182935
2019-01-16 05:19:52 [INFO    ] Finished processing BAM request
2019-01-16 05:19:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:19:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182935   8 58499 19192025 A  ERROR'
2019-01-16 05:19:52 [DEBUG   ] Got command BAM from MCS: ref #1182936
2019-01-16 05:19:52 [INFO    ] Finished processing BAM request
2019-01-16 05:19:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:19:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182936   8 58499 19192029 A  ERROR'
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 05:19:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 05:19:52 [DEBUG   ] spawn_process: at 2019-01-16 05:19:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 05:20:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 05:20:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 05:20:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:20:10 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 05:20:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:20:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:20:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:20:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:20:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:20:10 [DEBUG   ] Finished updating board flags in 1.594 seconds
2019-01-16 05:20:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 05:20:35 [DEBUG   ] Got command BAM from MCS: ref #1182937
2019-01-16 05:20:35 [INFO    ] Finished processing BAM request
2019-01-16 05:20:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:20:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182937   8 58499 19235025 A  ERROR'
2019-01-16 05:20:35 [DEBUG   ] Got command BAM from MCS: ref #1182938
2019-01-16 05:20:35 [INFO    ] Finished processing BAM request
2019-01-16 05:20:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:20:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182938   8 58499 19235029 A  ERROR'
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 05:20:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 05:20:35 [DEBUG   ] spawn_process: at 2019-01-16 05:20:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 05:20:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 05:21:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 05:21:05 [DEBUG   ] Got command RPT from MCS: ref #1182943
2019-01-16 05:21:05 [DEBUG   ] summary = ERROR
2019-01-16 05:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182943  13 58499 19265221 A  ERRORERROR'
2019-01-16 05:21:05 [DEBUG   ] Got command RPT from MCS: ref #1182944
2019-01-16 05:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182944  77 58499 19265222 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:21:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 05:21:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:21:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-16 05:21:10 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 05:21:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 05:21:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:21:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:21:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:21:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:21:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:21:10 [DEBUG   ] Finished updating board flags in 1.331 seconds
2019-01-16 05:21:18 [DEBUG   ] Got command BAM from MCS: ref #1182961
2019-01-16 05:21:18 [INFO    ] Finished processing BAM request
2019-01-16 05:21:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:21:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182961   8 58499 19278029 A  ERROR'
2019-01-16 05:21:18 [DEBUG   ] Got command BAM from MCS: ref #1182960
2019-01-16 05:21:18 [INFO    ] Finished processing BAM request
2019-01-16 05:21:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:21:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182960   8 58499 19278033 A  ERROR'
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 05:21:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 05:21:18 [DEBUG   ] spawn_process: at 2019-01-16 05:21:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 05:21:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 05:21:35 [DEBUG   ] Got command RPT from MCS: ref #1182962
2019-01-16 05:21:35 [DEBUG   ] summary = ERROR
2019-01-16 05:21:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182962  13 58499 19295997 A  ERRORERROR'
2019-01-16 05:21:36 [DEBUG   ] Got command RPT from MCS: ref #1182963
2019-01-16 05:21:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:21:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182963  77 58499 19296201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:21:36 [DEBUG   ] Got command RPT from MCS: ref #1182964
2019-01-16 05:21:36 [DEBUG   ] summary = ERROR
2019-01-16 05:21:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182964  13 58499 19296405 A  ERRORERROR'
2019-01-16 05:21:36 [DEBUG   ] Got command RPT from MCS: ref #1182965
2019-01-16 05:21:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:21:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182965  77 58499 19296597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:21:36 [DEBUG   ] Got command RPT from MCS: ref #1182966
2019-01-16 05:21:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 05:21:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182966  12 58499 19296801 A  ERRORB£ff'
2019-01-16 05:21:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 05:22:01 [DEBUG   ] Got command BAM from MCS: ref #1182967
2019-01-16 05:22:01 [INFO    ] Finished processing BAM request
2019-01-16 05:22:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182967   8 58499 19321033 A  ERROR'
2019-01-16 05:22:01 [DEBUG   ] Got command BAM from MCS: ref #1182968
2019-01-16 05:22:01 [INFO    ] Finished processing BAM request
2019-01-16 05:22:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 05:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1182968   8 58499 19321037 A  ERROR'
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 05:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 05:22:01 [DEBUG   ] spawn_process: at 2019-01-16 05:22:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 05:22:04 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-16 05:22:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-16 05:22:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:22:10 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 05:22:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:22:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:22:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:22:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:22:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:22:10 [DEBUG   ] Finished updating board flags in 1.215 seconds
2019-01-16 05:22:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 05:22:38 [DEBUG   ] Got command STP from MCS: ref #1182969
2019-01-16 05:22:38 [INFO    ] Finished processing BAM request
2019-01-16 05:22:38 [INFO    ] Shutdown the adder chain on beam #2
2019-01-16 05:22:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP  1182969   8 58499 19358029 A  ERROR'
2019-01-16 05:22:38 [DEBUG   ] Got command STP from MCS: ref #1182970
2019-01-16 05:22:38 [INFO    ] Finished processing BAM request
2019-01-16 05:22:38 [INFO    ] Shutdown the adder chain on beam #4
2019-01-16 05:22:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP  1182970   8 58499 19358033 A  ERROR'
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 05:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 05:22:38 [DEBUG   ] spawn_process: at 2019-01-16 05:22:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 05:22:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 05:23:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 05:23:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:23:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:23:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:23:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:23:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:23:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:23:10 [DEBUG   ] Finished updating board flags in 1.232 seconds
2019-01-16 05:23:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 05:23:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 05:24:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 05:24:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:24:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-16 05:24:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:24:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:24:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:24:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:24:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:24:10 [DEBUG   ] Finished updating board flags in 1.166 seconds
2019-01-16 05:24:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 05:24:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 05:25:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 05:25:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:25:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 05:25:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:25:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:25:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:25:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:25:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:25:10 [DEBUG   ] Finished updating board flags in 1.010 seconds
2019-01-16 05:25:24 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-16 05:25:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 05:26:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 05:26:05 [DEBUG   ] Got command RPT from MCS: ref #1182975
2019-01-16 05:26:05 [DEBUG   ] summary = ERROR
2019-01-16 05:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182975  13 58499 19565225 A  ERRORERROR'
2019-01-16 05:26:05 [DEBUG   ] Got command RPT from MCS: ref #1182976
2019-01-16 05:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182976  77 58499 19565226 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:26:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:26:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:26:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:26:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:26:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:26:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:26:10 [DEBUG   ] Finished updating board flags in 0.981 seconds
2019-01-16 05:26:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 05:26:36 [DEBUG   ] Got command RPT from MCS: ref #1182994
2019-01-16 05:26:36 [DEBUG   ] summary = ERROR
2019-01-16 05:26:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182994  13 58499 19596089 A  ERRORERROR'
2019-01-16 05:26:36 [DEBUG   ] Got command RPT from MCS: ref #1182995
2019-01-16 05:26:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:26:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182995  77 58499 19596281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:26:36 [DEBUG   ] Got command RPT from MCS: ref #1182996
2019-01-16 05:26:36 [DEBUG   ] summary = ERROR
2019-01-16 05:26:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182996  13 58499 19596485 A  ERRORERROR'
2019-01-16 05:26:36 [DEBUG   ] Got command RPT from MCS: ref #1182998
2019-01-16 05:26:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:26:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182998  77 58499 19596689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:26:36 [DEBUG   ] Got command RPT from MCS: ref #1182999
2019-01-16 05:26:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 05:26:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1182999  12 58499 19596893 A  ERRORB™™š'
2019-01-16 05:26:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 05:27:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 05:27:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:27:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:27:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:27:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:27:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:27:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:27:11 [DEBUG   ] Finished updating board flags in 1.854 seconds
2019-01-16 05:27:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 05:27:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 05:28:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 05:28:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:28:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 05:28:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:28:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:28:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:28:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:28:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:28:11 [DEBUG   ] Finished updating board flags in 1.784 seconds
2019-01-16 05:28:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 05:28:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 05:29:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 05:29:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:29:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:29:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:29:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:29:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:29:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:29:10 [DEBUG   ] Finished updating board flags in 1.035 seconds
2019-01-16 05:29:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 05:29:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 05:30:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 05:30:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 05:30:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:30:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:30:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:30:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:30:10 [WARNING ] (13, 1, 'bot')
2019-01-16 05:30:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:30:10 [DEBUG   ] Finished updating board flags in 1.040 seconds
2019-01-16 05:30:24 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-16 05:30:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 05:31:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 05:31:05 [DEBUG   ] Got command RPT from MCS: ref #1183012
2019-01-16 05:31:05 [DEBUG   ] summary = ERROR
2019-01-16 05:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183012  13 58499 19865225 A  ERRORERROR'
2019-01-16 05:31:05 [DEBUG   ] Got command RPT from MCS: ref #1183013
2019-01-16 05:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183013  77 58499 19865226 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:31:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 05:31:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:31:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:31:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:31:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:31:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:31:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:31:11 [DEBUG   ] Finished updating board flags in 1.534 seconds
2019-01-16 05:31:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 05:31:36 [DEBUG   ] Got command RPT from MCS: ref #1183029
2019-01-16 05:31:36 [DEBUG   ] summary = ERROR
2019-01-16 05:31:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183029  13 58499 19896169 A  ERRORERROR'
2019-01-16 05:31:36 [DEBUG   ] Got command RPT from MCS: ref #1183030
2019-01-16 05:31:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:31:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183030  77 58499 19896373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:31:36 [DEBUG   ] Got command RPT from MCS: ref #1183031
2019-01-16 05:31:36 [DEBUG   ] summary = ERROR
2019-01-16 05:31:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183031  13 58499 19896577 A  ERRORERROR'
2019-01-16 05:31:36 [DEBUG   ] Got command RPT from MCS: ref #1183032
2019-01-16 05:31:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:31:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183032  77 58499 19896777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:31:36 [DEBUG   ] Got command RPT from MCS: ref #1183033
2019-01-16 05:31:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 05:31:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183033  12 58499 19896977 A  ERRORB—™š'
2019-01-16 05:31:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 05:32:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 05:32:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:32:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:32:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:32:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:32:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:32:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:32:11 [DEBUG   ] Finished updating board flags in 1.376 seconds
2019-01-16 05:32:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 05:32:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 05:33:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 05:33:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 05:33:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:33:11 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 05:33:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:33:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:33:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:33:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:33:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:33:11 [DEBUG   ] Finished updating board flags in 1.242 seconds
2019-01-16 05:33:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 05:33:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 05:34:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 05:34:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:34:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:34:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:34:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:34:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:34:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:34:11 [DEBUG   ] Finished updating board flags in 1.163 seconds
2019-01-16 05:34:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 05:34:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 05:35:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 05:35:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 05:35:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:35:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:35:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:35:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:35:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:35:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:35:11 [DEBUG   ] Finished updating board flags in 1.026 seconds
2019-01-16 05:35:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 05:35:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 05:36:04 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-16 05:36:05 [DEBUG   ] Got command RPT from MCS: ref #1183042
2019-01-16 05:36:05 [DEBUG   ] summary = ERROR
2019-01-16 05:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183042  13 58499 20165225 A  ERRORERROR'
2019-01-16 05:36:05 [DEBUG   ] Got command RPT from MCS: ref #1183043
2019-01-16 05:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183043  77 58499 20165226 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:36:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:36:12 [WARNING ] (13, 1, 'bot')
2019-01-16 05:36:12 [WARNING ] (13, 1, 'bot')
2019-01-16 05:36:12 [WARNING ] (13, 1, 'bot')
2019-01-16 05:36:12 [WARNING ] (13, 1, 'bot')
2019-01-16 05:36:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:36:12 [DEBUG   ] Finished updating board flags in 1.999 seconds
2019-01-16 05:36:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 05:36:36 [DEBUG   ] Got command RPT from MCS: ref #1183061
2019-01-16 05:36:36 [DEBUG   ] summary = ERROR
2019-01-16 05:36:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183061  13 58499 20196257 A  ERRORERROR'
2019-01-16 05:36:36 [DEBUG   ] Got command RPT from MCS: ref #1183062
2019-01-16 05:36:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:36:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183062  77 58499 20196449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:36:36 [DEBUG   ] Got command RPT from MCS: ref #1183063
2019-01-16 05:36:36 [DEBUG   ] summary = ERROR
2019-01-16 05:36:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183063  13 58499 20196653 A  ERRORERROR'
2019-01-16 05:36:36 [DEBUG   ] Got command RPT from MCS: ref #1183065
2019-01-16 05:36:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:36:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183065  77 58499 20196857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:36:37 [DEBUG   ] Got command RPT from MCS: ref #1183067
2019-01-16 05:36:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 05:36:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183067  12 58499 20197061 A  ERRORB˜™š'
2019-01-16 05:36:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 05:37:04 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 05:37:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:37:12 [WARNING ] (13, 1, 'bot')
2019-01-16 05:37:12 [WARNING ] (13, 1, 'bot')
2019-01-16 05:37:12 [WARNING ] (13, 1, 'bot')
2019-01-16 05:37:12 [WARNING ] (13, 1, 'bot')
2019-01-16 05:37:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:37:12 [DEBUG   ] Finished updating board flags in 1.786 seconds
2019-01-16 05:37:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 05:37:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 05:38:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 05:38:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:38:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:38:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:38:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:38:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:38:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:38:11 [DEBUG   ] Finished updating board flags in 1.071 seconds
2019-01-16 05:38:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 05:38:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 05:39:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 05:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:39:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:39:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:39:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:39:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:39:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:39:11 [DEBUG   ] Finished updating board flags in 1.031 seconds
2019-01-16 05:39:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 05:39:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 05:40:04 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 05:40:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:40:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:40:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:40:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:40:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:40:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:40:11 [DEBUG   ] Finished updating board flags in 1.024 seconds
2019-01-16 05:40:24 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-16 05:40:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 05:41:05 [DEBUG   ] Got command RPT from MCS: ref #1183075
2019-01-16 05:41:05 [DEBUG   ] summary = ERROR
2019-01-16 05:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183075  13 58499 20465225 A  ERRORERROR'
2019-01-16 05:41:05 [DEBUG   ] Got command RPT from MCS: ref #1183076
2019-01-16 05:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183076  77 58499 20465226 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:41:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 05:41:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:41:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:41:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:41:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:41:11 [WARNING ] (13, 1, 'bot')
2019-01-16 05:41:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:41:11 [DEBUG   ] Finished updating board flags in 0.915 seconds
2019-01-16 05:41:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 05:41:36 [DEBUG   ] Got command RPT from MCS: ref #1183092
2019-01-16 05:41:36 [DEBUG   ] summary = ERROR
2019-01-16 05:41:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183092  13 58499 20496337 A  ERRORERROR'
2019-01-16 05:41:36 [DEBUG   ] Got command RPT from MCS: ref #1183093
2019-01-16 05:41:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:41:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183093  77 58499 20496541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:41:36 [DEBUG   ] Got command RPT from MCS: ref #1183094
2019-01-16 05:41:36 [DEBUG   ] summary = ERROR
2019-01-16 05:41:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183094  13 58499 20496745 A  ERRORERROR'
2019-01-16 05:41:36 [DEBUG   ] Got command RPT from MCS: ref #1183095
2019-01-16 05:41:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:41:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183095  77 58499 20496937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:41:37 [DEBUG   ] Got command RPT from MCS: ref #1183096
2019-01-16 05:41:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 05:41:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183096  12 58499 20497141 A  ERRORB˜™š'
2019-01-16 05:41:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 05:42:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 05:42:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 05:42:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:42:12 [WARNING ] (13, 1, 'bot')
2019-01-16 05:42:12 [WARNING ] (13, 1, 'bot')
2019-01-16 05:42:12 [WARNING ] (13, 1, 'bot')
2019-01-16 05:42:12 [WARNING ] (13, 1, 'bot')
2019-01-16 05:42:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:42:12 [DEBUG   ] Finished updating board flags in 1.381 seconds
2019-01-16 05:42:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 05:42:45 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2019-01-16 05:43:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 05:43:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:43:12 [WARNING ] (13, 1, 'bot')
2019-01-16 05:43:12 [WARNING ] (13, 1, 'bot')
2019-01-16 05:43:12 [WARNING ] (13, 1, 'bot')
2019-01-16 05:43:12 [WARNING ] (13, 1, 'bot')
2019-01-16 05:43:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:43:12 [DEBUG   ] Finished updating board flags in 1.184 seconds
2019-01-16 05:43:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 05:43:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 05:44:00 [DEBUG   ] Got command TBN from MCS: ref #1183101
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547617441']
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547617441']
2019-01-16 05:44:00 [DEBUG   ] tbn = exited with status True, code 0x00
2019-01-16 05:44:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN  1183101   8 58499 20640469 A  ERROR'
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547617441']
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547617441']
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547617441']
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547617441']
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547617441']
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547617441']
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547617441']
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547617441']
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547617441']
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547617441']
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547617441']
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547617441']
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547617441']
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547617441']
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547617441']
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547617441']
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547617441']
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547617441']
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547617441']
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547617441']
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547617441']
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547617441']
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547617441']
2019-01-16 05:44:00 [DEBUG   ] spawn_process: at 2019-01-16 05:44:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547617441']
2019-01-16 05:44:00 [INFO    ] Finished spawning TBN in 0.049 s
2019-01-16 05:44:05 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-16 05:44:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:44:12 [WARNING ] (13, 1, 'bot')
2019-01-16 05:44:12 [WARNING ] (13, 1, 'bot')
2019-01-16 05:44:12 [WARNING ] (13, 1, 'bot')
2019-01-16 05:44:12 [WARNING ] (13, 1, 'bot')
2019-01-16 05:44:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:44:12 [DEBUG   ] Finished updating board flags in 1.462 seconds
2019-01-16 05:44:25 [DEBUG   ] Finished updating ant stats in 1.066 seconds
2019-01-16 05:44:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 05:45:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 05:45:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 05:45:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-16 05:45:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:45:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:45:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:45:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:45:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:45:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:45:13 [DEBUG   ] Finished updating board flags in 2.197 seconds
2019-01-16 05:45:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-16 05:45:45 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-16 05:46:05 [DEBUG   ] Got command RPT from MCS: ref #1183106
2019-01-16 05:46:05 [DEBUG   ] summary = ERROR
2019-01-16 05:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183106  13 58499 20765229 A  ERRORERROR'
2019-01-16 05:46:05 [DEBUG   ] Got command RPT from MCS: ref #1183107
2019-01-16 05:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183107  77 58499 20765230 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:46:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 05:46:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 05:46:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:46:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:46:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:46:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:46:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:46:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:46:13 [DEBUG   ] Finished updating board flags in 1.967 seconds
2019-01-16 05:46:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-16 05:46:36 [DEBUG   ] Got command RPT from MCS: ref #1183125
2019-01-16 05:46:36 [DEBUG   ] summary = ERROR
2019-01-16 05:46:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183125  13 58499 20796425 A  ERRORERROR'
2019-01-16 05:46:36 [DEBUG   ] Got command RPT from MCS: ref #1183126
2019-01-16 05:46:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:46:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183126  77 58499 20796629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:46:36 [DEBUG   ] Got command RPT from MCS: ref #1183127
2019-01-16 05:46:36 [DEBUG   ] summary = ERROR
2019-01-16 05:46:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183127  13 58499 20796821 A  ERRORERROR'
2019-01-16 05:46:37 [DEBUG   ] Got command RPT from MCS: ref #1183129
2019-01-16 05:46:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:46:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183129  77 58499 20797025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:46:37 [DEBUG   ] Got command RPT from MCS: ref #1183130
2019-01-16 05:46:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 05:46:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183130  12 58499 20797229 A  ERRORB˜™š'
2019-01-16 05:46:46 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-16 05:47:06 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-16 05:47:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:47:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:47:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:47:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:47:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:47:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:47:13 [DEBUG   ] Finished updating board flags in 1.823 seconds
2019-01-16 05:47:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 05:47:46 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-16 05:48:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 05:48:11 [DEBUG   ] Got command TBW from MCS: ref #1183140
2019-01-16 05:48:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-01-16 05:48:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1183140   8 58499 20891545 A  ERROR'
2019-01-16 05:48:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-01-16 05:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-01-16 05:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-01-16 05:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-01-16 05:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-01-16 05:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-01-16 05:48:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:48:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:48:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:48:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:48:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:48:13 [DEBUG   ] Finished updating board flags in 1.776 seconds
2019-01-16 05:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-01-16 05:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-01-16 05:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-01-16 05:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-01-16 05:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-01-16 05:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-01-16 05:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-01-16 05:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-01-16 05:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-01-16 05:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-01-16 05:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-01-16 05:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-01-16 05:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-01-16 05:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-01-16 05:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-01-16 05:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-01-16 05:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-01-16 05:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-01-16 05:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-01-16 05:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-01-16 05:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-01-16 05:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-01-16 05:48:15 [DEBUG   ] spawn_process: at 2019-01-16 05:48:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-01-16 05:48:15 [INFO    ] Finished spawning TBW
2019-01-16 05:49:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:49:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:49:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:49:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:49:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:49:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:49:13 [DEBUG   ] Finished updating board flags in 1.570 seconds
2019-01-16 05:50:03 [INFO    ] __waitForTBW - TBW finished in 108.823 s
2019-01-16 05:50:04 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2019-01-16 05:50:04 [INFO    ] Started antennas statistics background thread
2019-01-16 05:50:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547617806']
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547617806']
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547617806']
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547617806']
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547617806']
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547617806']
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547617806']
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547617806']
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547617806']
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547617806']
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547617806']
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547617806']
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547617806']
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547617806']
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547617806']
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547617806']
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547617806']
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547617806']
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547617806']
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547617806']
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547617806']
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547617806']
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547617806']
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547617806']
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547617806']
2019-01-16 05:50:04 [DEBUG   ] spawn_process: at 2019-01-16 05:50:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547617806']
2019-01-16 05:50:04 [INFO    ] Finished spawning TBN in 0.050 s
2019-01-16 05:50:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:50:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 05:50:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:50:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:50:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:50:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:50:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:50:13 [DEBUG   ] Finished updating board flags in 1.635 seconds
2019-01-16 05:50:25 [DEBUG   ] Finished updating ant stats in 1.266 seconds
2019-01-16 05:50:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 05:51:05 [DEBUG   ] Got command RPT from MCS: ref #1183152
2019-01-16 05:51:05 [DEBUG   ] summary = ERROR
2019-01-16 05:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183152  13 58499 21065229 A  ERRORERROR'
2019-01-16 05:51:05 [DEBUG   ] Got command RPT from MCS: ref #1183153
2019-01-16 05:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183153  77 58499 21065230 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:51:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 05:51:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:51:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:51:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:51:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:51:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:51:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:51:13 [DEBUG   ] Finished updating board flags in 1.633 seconds
2019-01-16 05:51:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 05:51:36 [DEBUG   ] Got command RPT from MCS: ref #1183169
2019-01-16 05:51:36 [DEBUG   ] summary = ERROR
2019-01-16 05:51:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183169  13 58499 21096517 A  ERRORERROR'
2019-01-16 05:51:36 [DEBUG   ] Got command RPT from MCS: ref #1183170
2019-01-16 05:51:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:51:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183170  77 58499 21096709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:51:36 [DEBUG   ] Got command RPT from MCS: ref #1183171
2019-01-16 05:51:36 [DEBUG   ] summary = ERROR
2019-01-16 05:51:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183171  13 58499 21096913 A  ERRORERROR'
2019-01-16 05:51:37 [DEBUG   ] Got command RPT from MCS: ref #1183172
2019-01-16 05:51:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:51:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183172  77 58499 21097117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:51:37 [DEBUG   ] Got command RPT from MCS: ref #1183173
2019-01-16 05:51:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 05:51:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183173  12 58499 21097321 A  ERRORB˜™š'
2019-01-16 05:51:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 05:52:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 05:52:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:52:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:52:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:52:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:52:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:52:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:52:13 [DEBUG   ] Finished updating board flags in 1.633 seconds
2019-01-16 05:52:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 05:52:45 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-16 05:53:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 05:53:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:53:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:53:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:53:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:53:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:53:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:53:13 [DEBUG   ] Finished updating board flags in 1.633 seconds
2019-01-16 05:53:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 05:53:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 05:54:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 05:54:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:54:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 05:54:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:54:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:54:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:54:13 [WARNING ] (13, 1, 'bot')
2019-01-16 05:54:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:54:13 [DEBUG   ] Finished updating board flags in 1.633 seconds
2019-01-16 05:54:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 05:54:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 05:55:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 05:55:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:55:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 05:55:14 [WARNING ] (13, 1, 'bot')
2019-01-16 05:55:14 [WARNING ] (13, 1, 'bot')
2019-01-16 05:55:14 [WARNING ] (13, 1, 'bot')
2019-01-16 05:55:14 [WARNING ] (13, 1, 'bot')
2019-01-16 05:55:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:55:14 [DEBUG   ] Finished updating board flags in 1.638 seconds
2019-01-16 05:55:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 05:55:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 05:56:05 [DEBUG   ] Got command RPT from MCS: ref #1183178
2019-01-16 05:56:05 [DEBUG   ] summary = ERROR
2019-01-16 05:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183178  13 58499 21365233 A  ERRORERROR'
2019-01-16 05:56:05 [DEBUG   ] Got command RPT from MCS: ref #1183179
2019-01-16 05:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183179  77 58499 21365234 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:56:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 05:56:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:56:14 [WARNING ] (13, 1, 'bot')
2019-01-16 05:56:14 [WARNING ] (13, 1, 'bot')
2019-01-16 05:56:14 [WARNING ] (13, 1, 'bot')
2019-01-16 05:56:14 [WARNING ] (13, 1, 'bot')
2019-01-16 05:56:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:56:14 [DEBUG   ] Finished updating board flags in 1.639 seconds
2019-01-16 05:56:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 05:56:36 [DEBUG   ] Got command RPT from MCS: ref #1183197
2019-01-16 05:56:36 [DEBUG   ] summary = ERROR
2019-01-16 05:56:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183197  13 58499 21396593 A  ERRORERROR'
2019-01-16 05:56:36 [DEBUG   ] Got command RPT from MCS: ref #1183198
2019-01-16 05:56:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:56:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183198  77 58499 21396797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:56:37 [DEBUG   ] Got command RPT from MCS: ref #1183199
2019-01-16 05:56:37 [DEBUG   ] summary = ERROR
2019-01-16 05:56:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183199  13 58499 21397001 A  ERRORERROR'
2019-01-16 05:56:37 [DEBUG   ] Got command RPT from MCS: ref #1183201
2019-01-16 05:56:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 05:56:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183201  77 58499 21397205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 05:56:37 [DEBUG   ] Got command RPT from MCS: ref #1183202
2019-01-16 05:56:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 05:56:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183202  12 58499 21397397 A  ERRORB™™š'
2019-01-16 05:56:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 05:57:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 05:57:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:57:14 [WARNING ] (13, 1, 'bot')
2019-01-16 05:57:14 [WARNING ] (13, 1, 'bot')
2019-01-16 05:57:14 [WARNING ] (13, 1, 'bot')
2019-01-16 05:57:14 [WARNING ] (13, 1, 'bot')
2019-01-16 05:57:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:57:14 [DEBUG   ] Finished updating board flags in 1.635 seconds
2019-01-16 05:57:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 05:57:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 05:58:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 05:58:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:58:14 [WARNING ] (13, 1, 'bot')
2019-01-16 05:58:14 [WARNING ] (13, 1, 'bot')
2019-01-16 05:58:14 [WARNING ] (13, 1, 'bot')
2019-01-16 05:58:14 [WARNING ] (13, 1, 'bot')
2019-01-16 05:58:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:58:14 [DEBUG   ] Finished updating board flags in 2.326 seconds
2019-01-16 05:58:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 05:58:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 05:59:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 05:59:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 05:59:14 [WARNING ] (13, 1, 'bot')
2019-01-16 05:59:14 [WARNING ] (13, 1, 'bot')
2019-01-16 05:59:14 [WARNING ] (13, 1, 'bot')
2019-01-16 05:59:14 [WARNING ] (13, 1, 'bot')
2019-01-16 05:59:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 05:59:14 [DEBUG   ] Finished updating board flags in 2.072 seconds
2019-01-16 05:59:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 05:59:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 06:00:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 06:00:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:00:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:00:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:00:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:00:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:00:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:00:14 [DEBUG   ] Finished updating board flags in 2.000 seconds
2019-01-16 06:00:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 06:00:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 06:01:05 [DEBUG   ] Got command RPT from MCS: ref #1183215
2019-01-16 06:01:05 [DEBUG   ] summary = ERROR
2019-01-16 06:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183215  13 58499 21665225 A  ERRORERROR'
2019-01-16 06:01:05 [DEBUG   ] Got command RPT from MCS: ref #1183216
2019-01-16 06:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183216  77 58499 21665226 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:01:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 06:01:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:01:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:01:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:01:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:01:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:01:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:01:14 [DEBUG   ] Finished updating board flags in 1.986 seconds
2019-01-16 06:01:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 06:01:36 [DEBUG   ] Got command RPT from MCS: ref #1183232
2019-01-16 06:01:36 [DEBUG   ] summary = ERROR
2019-01-16 06:01:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183232  13 58499 21696681 A  ERRORERROR'
2019-01-16 06:01:36 [DEBUG   ] Got command RPT from MCS: ref #1183233
2019-01-16 06:01:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:01:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183233  77 58499 21696885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:01:37 [DEBUG   ] Got command RPT from MCS: ref #1183234
2019-01-16 06:01:37 [DEBUG   ] summary = ERROR
2019-01-16 06:01:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183234  13 58499 21697089 A  ERRORERROR'
2019-01-16 06:01:37 [DEBUG   ] Got command RPT from MCS: ref #1183235
2019-01-16 06:01:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:01:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183235  77 58499 21697293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:01:37 [DEBUG   ] Got command RPT from MCS: ref #1183236
2019-01-16 06:01:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 06:01:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183236  12 58499 21697485 A  ERRORB˜™š'
2019-01-16 06:01:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 06:02:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 06:02:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 06:02:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:02:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 06:02:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:02:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:02:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:02:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:02:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:02:14 [DEBUG   ] Finished updating board flags in 1.805 seconds
2019-01-16 06:02:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 06:02:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 06:03:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 06:03:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 06:03:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:03:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:03:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:03:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:03:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:03:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:03:14 [DEBUG   ] Finished updating board flags in 1.794 seconds
2019-01-16 06:03:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 06:03:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 06:04:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 06:04:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 06:04:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:04:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:04:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:04:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:04:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:04:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:04:14 [DEBUG   ] Finished updating board flags in 1.675 seconds
2019-01-16 06:04:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 06:04:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 06:05:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 06:05:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:05:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:05:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:05:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:05:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:05:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:05:14 [DEBUG   ] Finished updating board flags in 1.647 seconds
2019-01-16 06:05:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 06:05:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 06:06:05 [DEBUG   ] Got command RPT from MCS: ref #1183245
2019-01-16 06:06:05 [DEBUG   ] summary = ERROR
2019-01-16 06:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183245  13 58499 21965233 A  ERRORERROR'
2019-01-16 06:06:05 [DEBUG   ] Got command RPT from MCS: ref #1183246
2019-01-16 06:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183246  77 58499 21965234 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:06:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 06:06:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:06:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:06:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:06:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:06:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:06:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:06:14 [DEBUG   ] Finished updating board flags in 1.504 seconds
2019-01-16 06:06:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 06:06:36 [DEBUG   ] Got command RPT from MCS: ref #1183264
2019-01-16 06:06:36 [DEBUG   ] summary = ERROR
2019-01-16 06:06:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183264  13 58499 21996769 A  ERRORERROR'
2019-01-16 06:06:36 [DEBUG   ] Got command RPT from MCS: ref #1183265
2019-01-16 06:06:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:06:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183265  77 58499 21996977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:06:37 [DEBUG   ] Got command RPT from MCS: ref #1183266
2019-01-16 06:06:37 [DEBUG   ] summary = ERROR
2019-01-16 06:06:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183266  13 58499 21997181 A  ERRORERROR'
2019-01-16 06:06:37 [DEBUG   ] Got command RPT from MCS: ref #1183268
2019-01-16 06:06:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:06:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183268  77 58499 21997373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:06:37 [DEBUG   ] Got command RPT from MCS: ref #1183270
2019-01-16 06:06:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 06:06:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183270  12 58499 21997577 A  ERRORB˜™š'
2019-01-16 06:06:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 06:07:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 06:07:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:07:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 06:07:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:07:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:07:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:07:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:07:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:07:14 [DEBUG   ] Finished updating board flags in 1.503 seconds
2019-01-16 06:07:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 06:07:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 06:08:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 06:08:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:08:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 06:08:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:08:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:08:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:08:14 [WARNING ] (13, 1, 'bot')
2019-01-16 06:08:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:08:14 [DEBUG   ] Finished updating board flags in 1.517 seconds
2019-01-16 06:08:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 06:08:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 06:09:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 06:09:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:09:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 06:09:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:09:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:09:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:09:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:09:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:09:15 [DEBUG   ] Finished updating board flags in 2.221 seconds
2019-01-16 06:09:25 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-16 06:09:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 06:10:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 06:10:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 06:10:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:10:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:10:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:10:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:10:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:10:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:10:15 [DEBUG   ] Finished updating board flags in 2.187 seconds
2019-01-16 06:10:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 06:10:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 06:11:05 [DEBUG   ] Got command RPT from MCS: ref #1183278
2019-01-16 06:11:05 [DEBUG   ] summary = ERROR
2019-01-16 06:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183278  13 58499 22265229 A  ERRORERROR'
2019-01-16 06:11:05 [DEBUG   ] Got command RPT from MCS: ref #1183279
2019-01-16 06:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183279  77 58499 22265230 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:11:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 06:11:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:11:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:11:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:11:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:11:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:11:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:11:15 [DEBUG   ] Finished updating board flags in 1.999 seconds
2019-01-16 06:11:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 06:11:36 [DEBUG   ] Got command RPT from MCS: ref #1183295
2019-01-16 06:11:36 [DEBUG   ] summary = ERROR
2019-01-16 06:11:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183295  13 58499 22296857 A  ERRORERROR'
2019-01-16 06:11:37 [DEBUG   ] Got command RPT from MCS: ref #1183296
2019-01-16 06:11:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:11:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183296  77 58499 22297061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:11:37 [DEBUG   ] Got command RPT from MCS: ref #1183297
2019-01-16 06:11:37 [DEBUG   ] summary = ERROR
2019-01-16 06:11:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183297  13 58499 22297265 A  ERRORERROR'
2019-01-16 06:11:37 [DEBUG   ] Got command RPT from MCS: ref #1183298
2019-01-16 06:11:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:11:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183298  77 58499 22297457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:11:37 [DEBUG   ] Got command RPT from MCS: ref #1183299
2019-01-16 06:11:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 06:11:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183299  12 58499 22297661 A  ERRORB™™š'
2019-01-16 06:11:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 06:12:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 06:12:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:12:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 06:12:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:12:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:12:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:12:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:12:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:12:15 [DEBUG   ] Finished updating board flags in 1.877 seconds
2019-01-16 06:12:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 06:12:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 06:13:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 06:13:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:13:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:13:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:13:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:13:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:13:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:13:15 [DEBUG   ] Finished updating board flags in 1.695 seconds
2019-01-16 06:13:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 06:13:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 06:14:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 06:14:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 06:14:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:14:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:14:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:14:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:14:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:14:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:14:15 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-01-16 06:14:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 06:14:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 06:15:05 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-16 06:15:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:15:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:15:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:15:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:15:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:15:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:15:15 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-01-16 06:15:25 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-01-16 06:15:46 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-16 06:16:05 [DEBUG   ] Got command RPT from MCS: ref #1183308
2019-01-16 06:16:05 [DEBUG   ] summary = ERROR
2019-01-16 06:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183308  13 58499 22565229 A  ERRORERROR'
2019-01-16 06:16:05 [DEBUG   ] Got command RPT from MCS: ref #1183309
2019-01-16 06:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183309  77 58499 22565230 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:16:05 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 06:16:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:16:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 06:16:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:16:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:16:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:16:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:16:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:16:15 [DEBUG   ] Finished updating board flags in 1.576 seconds
2019-01-16 06:16:25 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 06:16:36 [DEBUG   ] Got command RPT from MCS: ref #1183327
2019-01-16 06:16:36 [DEBUG   ] summary = ERROR
2019-01-16 06:16:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183327  13 58499 22596937 A  ERRORERROR'
2019-01-16 06:16:37 [DEBUG   ] Got command RPT from MCS: ref #1183328
2019-01-16 06:16:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:16:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183328  77 58499 22597141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:16:37 [DEBUG   ] Got command RPT from MCS: ref #1183329
2019-01-16 06:16:37 [DEBUG   ] summary = ERROR
2019-01-16 06:16:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183329  13 58499 22597345 A  ERRORERROR'
2019-01-16 06:16:37 [DEBUG   ] Got command RPT from MCS: ref #1183331
2019-01-16 06:16:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:16:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183331  77 58499 22597549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:16:37 [DEBUG   ] Got command RPT from MCS: ref #1183332
2019-01-16 06:16:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 06:16:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183332  12 58499 22597741 A  ERRORB˜™š'
2019-01-16 06:16:45 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-16 06:17:06 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-01-16 06:17:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:17:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 06:17:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:17:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:17:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:17:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:17:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:17:15 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-01-16 06:17:26 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-16 06:17:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 06:18:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 06:18:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:18:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:18:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:18:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:18:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:18:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:18:15 [DEBUG   ] Finished updating board flags in 1.385 seconds
2019-01-16 06:18:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 06:18:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-16 06:19:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 06:19:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:19:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 06:19:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:19:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:19:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:19:15 [WARNING ] (13, 1, 'bot')
2019-01-16 06:19:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:19:15 [DEBUG   ] Finished updating board flags in 1.466 seconds
2019-01-16 06:19:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 06:19:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 06:20:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 06:20:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:20:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 06:20:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:20:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:20:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:20:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:20:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:20:16 [DEBUG   ] Finished updating board flags in 2.243 seconds
2019-01-16 06:20:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 06:20:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 06:21:05 [DEBUG   ] Got command RPT from MCS: ref #1183345
2019-01-16 06:21:05 [DEBUG   ] summary = ERROR
2019-01-16 06:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183345  13 58499 22865229 A  ERRORERROR'
2019-01-16 06:21:05 [DEBUG   ] Got command RPT from MCS: ref #1183346
2019-01-16 06:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183346  77 58499 22865230 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:21:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 06:21:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:21:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:21:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:21:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:21:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:21:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:21:16 [DEBUG   ] Finished updating board flags in 2.181 seconds
2019-01-16 06:21:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 06:21:37 [DEBUG   ] Got command RPT from MCS: ref #1183362
2019-01-16 06:21:37 [DEBUG   ] summary = ERROR
2019-01-16 06:21:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183362  13 58499 22897033 A  ERRORERROR'
2019-01-16 06:21:37 [DEBUG   ] Got command RPT from MCS: ref #1183363
2019-01-16 06:21:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:21:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183363  77 58499 22897225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:21:37 [DEBUG   ] Got command RPT from MCS: ref #1183364
2019-01-16 06:21:37 [DEBUG   ] summary = ERROR
2019-01-16 06:21:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183364  13 58499 22897429 A  ERRORERROR'
2019-01-16 06:21:37 [DEBUG   ] Got command RPT from MCS: ref #1183365
2019-01-16 06:21:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:21:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183365  77 58499 22897633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:21:37 [DEBUG   ] Got command RPT from MCS: ref #1183366
2019-01-16 06:21:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 06:21:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183366  12 58499 22897837 A  ERRORB˜™š'
2019-01-16 06:21:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 06:22:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 06:22:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 06:22:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:22:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-16 06:22:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:22:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:22:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:22:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:22:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:22:16 [DEBUG   ] Finished updating board flags in 2.033 seconds
2019-01-16 06:22:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 06:22:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 06:23:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 06:23:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:23:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:23:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:23:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:23:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:23:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:23:16 [DEBUG   ] Finished updating board flags in 1.897 seconds
2019-01-16 06:23:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 06:23:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 06:24:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 06:24:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:24:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:24:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:24:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:24:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:24:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:24:16 [DEBUG   ] Finished updating board flags in 1.824 seconds
2019-01-16 06:24:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 06:24:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 06:25:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 06:25:15 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 06:25:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:25:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:25:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:25:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:25:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:25:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:25:16 [DEBUG   ] Finished updating board flags in 1.793 seconds
2019-01-16 06:25:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-16 06:25:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 06:26:05 [DEBUG   ] Got command RPT from MCS: ref #1183371
2019-01-16 06:26:05 [DEBUG   ] summary = ERROR
2019-01-16 06:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183371  13 58499 23165241 A  ERRORERROR'
2019-01-16 06:26:05 [DEBUG   ] Got command RPT from MCS: ref #1183372
2019-01-16 06:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183372  77 58499 23165242 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:26:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 06:26:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:26:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:26:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:26:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:26:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:26:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:26:16 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-01-16 06:26:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 06:26:37 [DEBUG   ] Got command RPT from MCS: ref #1183390
2019-01-16 06:26:37 [DEBUG   ] summary = ERROR
2019-01-16 06:26:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183390  13 58499 23197109 A  ERRORERROR'
2019-01-16 06:26:37 [DEBUG   ] Got command RPT from MCS: ref #1183391
2019-01-16 06:26:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:26:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183391  77 58499 23197313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:26:37 [DEBUG   ] Got command RPT from MCS: ref #1183392
2019-01-16 06:26:37 [DEBUG   ] summary = ERROR
2019-01-16 06:26:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183392  13 58499 23197517 A  ERRORERROR'
2019-01-16 06:26:37 [DEBUG   ] Got command RPT from MCS: ref #1183394
2019-01-16 06:26:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:26:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183394  77 58499 23197721 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:26:37 [DEBUG   ] Got command RPT from MCS: ref #1183396
2019-01-16 06:26:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 06:26:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183396  12 58499 23197913 A  ERRORB˜™š'
2019-01-16 06:26:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-16 06:27:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 06:27:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 06:27:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:27:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:27:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:27:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:27:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:27:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:27:16 [DEBUG   ] Finished updating board flags in 1.642 seconds
2019-01-16 06:27:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 06:27:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 06:28:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-16 06:28:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:28:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:28:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:28:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:28:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:28:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:28:16 [DEBUG   ] Finished updating board flags in 1.579 seconds
2019-01-16 06:28:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 06:28:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 06:29:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 06:29:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:29:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:29:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:29:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:29:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:29:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:29:16 [DEBUG   ] Finished updating board flags in 1.536 seconds
2019-01-16 06:29:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-16 06:29:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 06:30:06 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-16 06:30:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 06:30:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:30:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:30:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:30:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:30:16 [WARNING ] (13, 1, 'bot')
2019-01-16 06:30:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:30:16 [DEBUG   ] Finished updating board flags in 1.549 seconds
2019-01-16 06:30:26 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-16 06:30:47 [DEBUG   ] Finished updating ant stats in 1.802 seconds
2019-01-16 06:31:05 [DEBUG   ] Got command RPT from MCS: ref #1183408
2019-01-16 06:31:05 [DEBUG   ] summary = ERROR
2019-01-16 06:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183408  13 58499 23465233 A  ERRORERROR'
2019-01-16 06:31:05 [DEBUG   ] Got command RPT from MCS: ref #1183409
2019-01-16 06:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183409  77 58499 23465234 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:31:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 06:31:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:31:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:31:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:31:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:31:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:31:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:31:17 [DEBUG   ] Finished updating board flags in 2.139 seconds
2019-01-16 06:31:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 06:31:37 [DEBUG   ] Got command RPT from MCS: ref #1183425
2019-01-16 06:31:37 [DEBUG   ] summary = ERROR
2019-01-16 06:31:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183425  13 58499 23497201 A  ERRORERROR'
2019-01-16 06:31:37 [DEBUG   ] Got command RPT from MCS: ref #1183426
2019-01-16 06:31:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:31:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183426  77 58499 23497405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:31:37 [DEBUG   ] Got command RPT from MCS: ref #1183427
2019-01-16 06:31:37 [DEBUG   ] summary = ERROR
2019-01-16 06:31:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183427  13 58499 23497609 A  ERRORERROR'
2019-01-16 06:31:37 [DEBUG   ] Got command RPT from MCS: ref #1183428
2019-01-16 06:31:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:31:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183428  77 58499 23497801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:31:38 [DEBUG   ] Got command RPT from MCS: ref #1183429
2019-01-16 06:31:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 06:31:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183429  12 58499 23498005 A  ERRORB—™š'
2019-01-16 06:31:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 06:32:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-16 06:32:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:32:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:32:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:32:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:32:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:32:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:32:17 [DEBUG   ] Finished updating board flags in 1.928 seconds
2019-01-16 06:32:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 06:32:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 06:33:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 06:33:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:33:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:33:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:33:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:33:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:33:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:33:17 [DEBUG   ] Finished updating board flags in 1.894 seconds
2019-01-16 06:33:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 06:33:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 06:34:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 06:34:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:34:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:34:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:34:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:34:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:34:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:34:17 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-01-16 06:34:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-16 06:34:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-16 06:35:07 [DEBUG   ] Finished updating ant stats in 1.604 seconds
2019-01-16 06:35:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 06:35:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:35:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:35:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:35:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:35:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:35:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:35:17 [DEBUG   ] Finished updating board flags in 1.713 seconds
2019-01-16 06:35:27 [DEBUG   ] Finished updating ant stats in 1.594 seconds
2019-01-16 06:35:47 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-16 06:36:05 [DEBUG   ] Got command RPT from MCS: ref #1183438
2019-01-16 06:36:05 [DEBUG   ] summary = ERROR
2019-01-16 06:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183438  13 58499 23765233 A  ERRORERROR'
2019-01-16 06:36:05 [DEBUG   ] Got command RPT from MCS: ref #1183439
2019-01-16 06:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183439  77 58499 23765234 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:36:07 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-16 06:36:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:36:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 06:36:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:36:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:36:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:36:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:36:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:36:17 [DEBUG   ] Finished updating board flags in 1.609 seconds
2019-01-16 06:36:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 06:36:37 [DEBUG   ] Got command RPT from MCS: ref #1183457
2019-01-16 06:36:37 [DEBUG   ] summary = ERROR
2019-01-16 06:36:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183457  13 58499 23797293 A  ERRORERROR'
2019-01-16 06:36:37 [DEBUG   ] Got command RPT from MCS: ref #1183458
2019-01-16 06:36:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:36:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183458  77 58499 23797486 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:36:37 [DEBUG   ] Got command RPT from MCS: ref #1183459
2019-01-16 06:36:37 [DEBUG   ] summary = ERROR
2019-01-16 06:36:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183459  13 58499 23797690 A  ERRORERROR'
2019-01-16 06:36:37 [DEBUG   ] Got command RPT from MCS: ref #1183461
2019-01-16 06:36:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:36:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183461  77 58499 23797893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:36:38 [DEBUG   ] Got command RPT from MCS: ref #1183462
2019-01-16 06:36:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 06:36:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183462  12 58499 23798098 A  ERRORB˜™š'
2019-01-16 06:36:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 06:37:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 06:37:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:37:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 06:37:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:37:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:37:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:37:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:37:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:37:17 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-16 06:37:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 06:37:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 06:38:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 06:38:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:38:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:38:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:38:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:38:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:38:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:38:17 [DEBUG   ] Finished updating board flags in 1.572 seconds
2019-01-16 06:38:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 06:38:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 06:39:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 06:39:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:39:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 06:39:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:39:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:39:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:39:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:39:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:39:17 [DEBUG   ] Finished updating board flags in 1.450 seconds
2019-01-16 06:39:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 06:39:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 06:40:07 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-01-16 06:40:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 06:40:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:40:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:40:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:40:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:40:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:40:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:40:17 [DEBUG   ] Finished updating board flags in 1.414 seconds
2019-01-16 06:40:27 [DEBUG   ] Finished updating ant stats in 1.192 seconds
2019-01-16 06:40:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 06:41:05 [DEBUG   ] Got command RPT from MCS: ref #1183471
2019-01-16 06:41:05 [DEBUG   ] summary = ERROR
2019-01-16 06:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183471  13 58499 24065241 A  ERRORERROR'
2019-01-16 06:41:05 [DEBUG   ] Got command RPT from MCS: ref #1183472
2019-01-16 06:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183472  77 58499 24065242 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:41:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-16 06:41:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:41:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:41:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:41:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:41:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:41:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:41:17 [DEBUG   ] Finished updating board flags in 1.337 seconds
2019-01-16 06:41:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 06:41:37 [DEBUG   ] Got command RPT from MCS: ref #1183488
2019-01-16 06:41:37 [DEBUG   ] summary = ERROR
2019-01-16 06:41:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183488  13 58499 24097381 A  ERRORERROR'
2019-01-16 06:41:37 [DEBUG   ] Got command RPT from MCS: ref #1183489
2019-01-16 06:41:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:41:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183489  77 58499 24097573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:41:37 [DEBUG   ] Got command RPT from MCS: ref #1183490
2019-01-16 06:41:37 [DEBUG   ] summary = ERROR
2019-01-16 06:41:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183490  13 58499 24097777 A  ERRORERROR'
2019-01-16 06:41:37 [DEBUG   ] Got command RPT from MCS: ref #1183491
2019-01-16 06:41:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:41:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183491  77 58499 24097981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:41:38 [DEBUG   ] Got command RPT from MCS: ref #1183492
2019-01-16 06:41:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 06:41:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183492  12 58499 24098185 A  ERRORB˜™š'
2019-01-16 06:41:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 06:42:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 06:42:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 06:42:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:42:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:42:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:42:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:42:17 [WARNING ] (13, 1, 'bot')
2019-01-16 06:42:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:42:17 [DEBUG   ] Finished updating board flags in 1.547 seconds
2019-01-16 06:42:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 06:42:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 06:43:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 06:43:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:43:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:43:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:43:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:43:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:43:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:43:18 [DEBUG   ] Finished updating board flags in 2.165 seconds
2019-01-16 06:43:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 06:43:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 06:44:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 06:44:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:44:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 06:44:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:44:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:44:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:44:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:44:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:44:18 [DEBUG   ] Finished updating board flags in 1.897 seconds
2019-01-16 06:44:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 06:44:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 06:45:07 [DEBUG   ] Finished updating ant stats in 1.013 seconds
2019-01-16 06:45:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:45:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-16 06:45:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:45:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:45:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:45:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:45:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:45:18 [DEBUG   ] Finished updating board flags in 1.862 seconds
2019-01-16 06:45:27 [DEBUG   ] Finished updating ant stats in 0.990 seconds
2019-01-16 06:45:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 06:46:05 [DEBUG   ] Got command RPT from MCS: ref #1183501
2019-01-16 06:46:05 [DEBUG   ] summary = ERROR
2019-01-16 06:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183501  13 58499 24365245 A  ERRORERROR'
2019-01-16 06:46:05 [DEBUG   ] Got command RPT from MCS: ref #1183502
2019-01-16 06:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183502  77 58499 24365246 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:46:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 06:46:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:46:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:46:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:46:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:46:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:46:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:46:18 [DEBUG   ] Finished updating board flags in 1.744 seconds
2019-01-16 06:46:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-16 06:46:37 [DEBUG   ] Got command RPT from MCS: ref #1183520
2019-01-16 06:46:37 [DEBUG   ] summary = ERROR
2019-01-16 06:46:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183520  13 58499 24397465 A  ERRORERROR'
2019-01-16 06:46:37 [DEBUG   ] Got command RPT from MCS: ref #1183521
2019-01-16 06:46:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:46:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183521  77 58499 24397657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:46:37 [DEBUG   ] Got command RPT from MCS: ref #1183522
2019-01-16 06:46:37 [DEBUG   ] summary = ERROR
2019-01-16 06:46:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183522  13 58499 24397861 A  ERRORERROR'
2019-01-16 06:46:38 [DEBUG   ] Got command RPT from MCS: ref #1183524
2019-01-16 06:46:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:46:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183524  77 58499 24398073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:46:38 [DEBUG   ] Got command RPT from MCS: ref #1183525
2019-01-16 06:46:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 06:46:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183525  12 58499 24398261 A  ERRORB™™š'
2019-01-16 06:46:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 06:47:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 06:47:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:47:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:47:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:47:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:47:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:47:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:47:18 [DEBUG   ] Finished updating board flags in 1.626 seconds
2019-01-16 06:47:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 06:47:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 06:48:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 06:48:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:48:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:48:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:48:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:48:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:48:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:48:18 [DEBUG   ] Finished updating board flags in 1.582 seconds
2019-01-16 06:48:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 06:48:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 06:49:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 06:49:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:49:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:49:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:49:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:49:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:49:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:49:18 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-01-16 06:49:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 06:49:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 06:50:07 [DEBUG   ] Finished updating ant stats in 0.812 seconds
2019-01-16 06:50:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:50:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:50:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:50:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:50:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:50:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:50:18 [DEBUG   ] Finished updating board flags in 1.429 seconds
2019-01-16 06:50:27 [DEBUG   ] Finished updating ant stats in 0.784 seconds
2019-01-16 06:50:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 06:51:05 [DEBUG   ] Got command RPT from MCS: ref #1183538
2019-01-16 06:51:05 [DEBUG   ] summary = ERROR
2019-01-16 06:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183538  13 58499 24665245 A  ERRORERROR'
2019-01-16 06:51:05 [DEBUG   ] Got command RPT from MCS: ref #1183539
2019-01-16 06:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183539  77 58499 24665246 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:51:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 06:51:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:51:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:51:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:51:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:51:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:51:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:51:18 [DEBUG   ] Finished updating board flags in 1.438 seconds
2019-01-16 06:51:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 06:51:37 [DEBUG   ] Got command RPT from MCS: ref #1183555
2019-01-16 06:51:37 [DEBUG   ] summary = ERROR
2019-01-16 06:51:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183555  13 58499 24697549 A  ERRORERROR'
2019-01-16 06:51:37 [DEBUG   ] Got command RPT from MCS: ref #1183556
2019-01-16 06:51:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:51:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183556  77 58499 24697753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:51:37 [DEBUG   ] Got command RPT from MCS: ref #1183557
2019-01-16 06:51:37 [DEBUG   ] summary = ERROR
2019-01-16 06:51:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183557  13 58499 24697945 A  ERRORERROR'
2019-01-16 06:51:38 [DEBUG   ] Got command RPT from MCS: ref #1183558
2019-01-16 06:51:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:51:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183558  77 58499 24698149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:51:38 [DEBUG   ] Got command RPT from MCS: ref #1183559
2019-01-16 06:51:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 06:51:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183559  12 58499 24698353 A  ERRORB˜™š'
2019-01-16 06:51:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 06:52:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 06:52:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:52:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:52:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:52:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:52:18 [WARNING ] (13, 1, 'bot')
2019-01-16 06:52:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:52:18 [DEBUG   ] Finished updating board flags in 1.583 seconds
2019-01-16 06:52:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 06:52:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 06:53:07 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-16 06:53:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 06:53:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:53:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:53:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:53:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:53:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:53:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:53:19 [DEBUG   ] Finished updating board flags in 2.263 seconds
2019-01-16 06:53:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 06:53:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 06:54:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 06:54:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:54:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 06:54:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 06:54:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:54:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:54:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:54:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:54:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:54:19 [DEBUG   ] Finished updating board flags in 2.091 seconds
2019-01-16 06:54:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-16 06:54:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-16 06:55:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 06:55:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:55:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:55:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:55:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:55:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:55:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:55:19 [DEBUG   ] Finished updating board flags in 2.016 seconds
2019-01-16 06:55:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 06:55:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 06:56:05 [DEBUG   ] Got command RPT from MCS: ref #1183564
2019-01-16 06:56:05 [DEBUG   ] summary = ERROR
2019-01-16 06:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183564  13 58499 24965249 A  ERRORERROR'
2019-01-16 06:56:05 [DEBUG   ] Got command RPT from MCS: ref #1183565
2019-01-16 06:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183565  77 58499 24965250 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:56:07 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-16 06:56:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:56:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:56:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:56:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:56:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:56:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:56:19 [DEBUG   ] Finished updating board flags in 1.991 seconds
2019-01-16 06:56:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 06:56:37 [DEBUG   ] Got command RPT from MCS: ref #1183583
2019-01-16 06:56:37 [DEBUG   ] summary = ERROR
2019-01-16 06:56:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183583  13 58499 24997637 A  ERRORERROR'
2019-01-16 06:56:37 [DEBUG   ] Got command RPT from MCS: ref #1183584
2019-01-16 06:56:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:56:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183584  77 58499 24997829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:56:38 [DEBUG   ] Got command RPT from MCS: ref #1183585
2019-01-16 06:56:38 [DEBUG   ] summary = ERROR
2019-01-16 06:56:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183585  13 58499 24998033 A  ERRORERROR'
2019-01-16 06:56:38 [DEBUG   ] Got command RPT from MCS: ref #1183587
2019-01-16 06:56:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 06:56:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183587  77 58499 24998237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 06:56:38 [DEBUG   ] Got command RPT from MCS: ref #1183588
2019-01-16 06:56:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 06:56:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183588  12 58499 24998441 A  ERRORB™™š'
2019-01-16 06:56:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 06:57:07 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-16 06:57:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:57:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:57:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:57:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:57:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:57:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:57:19 [DEBUG   ] Finished updating board flags in 1.817 seconds
2019-01-16 06:57:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 06:57:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 06:58:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 06:58:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:58:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:58:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:58:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:58:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:58:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:58:19 [DEBUG   ] Finished updating board flags in 1.915 seconds
2019-01-16 06:58:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-16 06:58:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 06:59:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 06:59:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 06:59:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:59:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:59:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:59:19 [WARNING ] (13, 1, 'bot')
2019-01-16 06:59:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 06:59:19 [DEBUG   ] Finished updating board flags in 1.675 seconds
2019-01-16 06:59:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 06:59:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 07:00:07 [DEBUG   ] Finished updating ant stats in 0.611 seconds
2019-01-16 07:00:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:00:19 [WARNING ] (13, 1, 'bot')
2019-01-16 07:00:19 [WARNING ] (13, 1, 'bot')
2019-01-16 07:00:19 [WARNING ] (13, 1, 'bot')
2019-01-16 07:00:19 [WARNING ] (13, 1, 'bot')
2019-01-16 07:00:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:00:19 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-16 07:00:27 [DEBUG   ] Finished updating ant stats in 0.591 seconds
2019-01-16 07:00:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 07:01:05 [DEBUG   ] Got command RPT from MCS: ref #1183601
2019-01-16 07:01:05 [DEBUG   ] summary = ERROR
2019-01-16 07:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183601  13 58499 25265249 A  ERRORERROR'
2019-01-16 07:01:05 [DEBUG   ] Got command RPT from MCS: ref #1183602
2019-01-16 07:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183602  77 58499 25265250 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:01:07 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-16 07:01:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-16 07:01:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:01:19 [WARNING ] (13, 1, 'bot')
2019-01-16 07:01:19 [WARNING ] (13, 1, 'bot')
2019-01-16 07:01:19 [WARNING ] (13, 1, 'bot')
2019-01-16 07:01:19 [WARNING ] (13, 1, 'bot')
2019-01-16 07:01:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:01:19 [DEBUG   ] Finished updating board flags in 1.581 seconds
2019-01-16 07:01:28 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-16 07:01:37 [DEBUG   ] Got command RPT from MCS: ref #1183618
2019-01-16 07:01:37 [DEBUG   ] summary = ERROR
2019-01-16 07:01:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183618  13 58499 25297717 A  ERRORERROR'
2019-01-16 07:01:37 [DEBUG   ] Got command RPT from MCS: ref #1183619
2019-01-16 07:01:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:01:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183619  77 58499 25297921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:01:38 [DEBUG   ] Got command RPT from MCS: ref #1183620
2019-01-16 07:01:38 [DEBUG   ] summary = ERROR
2019-01-16 07:01:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183620  13 58499 25298125 A  ERRORERROR'
2019-01-16 07:01:38 [DEBUG   ] Got command RPT from MCS: ref #1183621
2019-01-16 07:01:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:01:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183621  77 58499 25298329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:01:38 [DEBUG   ] Got command RPT from MCS: ref #1183622
2019-01-16 07:01:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 07:01:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183622  12 58499 25298521 A  ERRORB™™š'
2019-01-16 07:01:48 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-16 07:02:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 07:02:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 07:02:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:02:19 [WARNING ] (13, 1, 'bot')
2019-01-16 07:02:19 [WARNING ] (13, 1, 'bot')
2019-01-16 07:02:19 [WARNING ] (13, 1, 'bot')
2019-01-16 07:02:19 [WARNING ] (13, 1, 'bot')
2019-01-16 07:02:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:02:19 [DEBUG   ] Finished updating board flags in 1.482 seconds
2019-01-16 07:02:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 07:02:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 07:03:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 07:03:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-16 07:03:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:03:19 [WARNING ] (13, 1, 'bot')
2019-01-16 07:03:19 [WARNING ] (13, 1, 'bot')
2019-01-16 07:03:19 [WARNING ] (13, 1, 'bot')
2019-01-16 07:03:19 [WARNING ] (13, 1, 'bot')
2019-01-16 07:03:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:03:19 [DEBUG   ] Finished updating board flags in 1.480 seconds
2019-01-16 07:03:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 07:03:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 07:04:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 07:04:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:04:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 07:04:19 [WARNING ] (13, 1, 'bot')
2019-01-16 07:04:19 [WARNING ] (13, 1, 'bot')
2019-01-16 07:04:19 [WARNING ] (13, 1, 'bot')
2019-01-16 07:04:19 [WARNING ] (13, 1, 'bot')
2019-01-16 07:04:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:04:19 [DEBUG   ] Finished updating board flags in 1.503 seconds
2019-01-16 07:04:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 07:04:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 07:05:08 [DEBUG   ] Finished updating ant stats in 1.214 seconds
2019-01-16 07:05:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:05:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:05:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:05:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:05:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:05:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:05:20 [DEBUG   ] Finished updating board flags in 2.168 seconds
2019-01-16 07:05:28 [DEBUG   ] Finished updating ant stats in 1.190 seconds
2019-01-16 07:05:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 07:06:05 [DEBUG   ] Got command RPT from MCS: ref #1183631
2019-01-16 07:06:05 [DEBUG   ] summary = ERROR
2019-01-16 07:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183631  13 58499 25565245 A  ERRORERROR'
2019-01-16 07:06:05 [DEBUG   ] Got command RPT from MCS: ref #1183632
2019-01-16 07:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183632  77 58499 25565246 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:06:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-16 07:06:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 07:06:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:06:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 07:06:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:06:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:06:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:06:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:06:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:06:20 [DEBUG   ] Finished updating board flags in 1.979 seconds
2019-01-16 07:06:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 07:06:37 [DEBUG   ] Got command RPT from MCS: ref #1183650
2019-01-16 07:06:37 [DEBUG   ] summary = ERROR
2019-01-16 07:06:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183650  13 58499 25597805 A  ERRORERROR'
2019-01-16 07:06:38 [DEBUG   ] Got command RPT from MCS: ref #1183651
2019-01-16 07:06:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:06:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183651  77 58499 25598009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:06:38 [DEBUG   ] Got command RPT from MCS: ref #1183652
2019-01-16 07:06:38 [DEBUG   ] summary = ERROR
2019-01-16 07:06:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183652  13 58499 25598213 A  ERRORERROR'
2019-01-16 07:06:38 [DEBUG   ] Got command RPT from MCS: ref #1183654
2019-01-16 07:06:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:06:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183654  77 58499 25598405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:06:38 [DEBUG   ] Got command RPT from MCS: ref #1183656
2019-01-16 07:06:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 07:06:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183656  12 58499 25598609 A  ERRORB—™š'
2019-01-16 07:06:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 07:07:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 07:07:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 07:07:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:07:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:07:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:07:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:07:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:07:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:07:20 [DEBUG   ] Finished updating board flags in 1.905 seconds
2019-01-16 07:07:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 07:07:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 07:08:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 07:08:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:08:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2019-01-16 07:08:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:08:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:08:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:08:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:08:20 [WARNING ] (25, 5, 'bot')
2019-01-16 07:08:20 [WARNING ] (25, 5, 'bot')
2019-01-16 07:08:20 [WARNING ] (25, 5, 'bot')
2019-01-16 07:08:20 [WARNING ] (25, 5, 'bot')
2019-01-16 07:08:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:08:20 [DEBUG   ] Finished updating board flags in 1.715 seconds
2019-01-16 07:08:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 07:08:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 07:09:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 07:09:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:09:20 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 07:09:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 07:09:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:09:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:09:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:09:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:09:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:09:20 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-01-16 07:09:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 07:09:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 07:10:08 [DEBUG   ] Finished updating ant stats in 1.012 seconds
2019-01-16 07:10:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:10:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:10:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:10:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:10:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:10:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:10:20 [DEBUG   ] Finished updating board flags in 1.567 seconds
2019-01-16 07:10:28 [DEBUG   ] Finished updating ant stats in 0.989 seconds
2019-01-16 07:10:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 07:11:05 [DEBUG   ] Got command RPT from MCS: ref #1183664
2019-01-16 07:11:05 [DEBUG   ] summary = ERROR
2019-01-16 07:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183664  13 58499 25865249 A  ERRORERROR'
2019-01-16 07:11:05 [DEBUG   ] Got command RPT from MCS: ref #1183665
2019-01-16 07:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183665  77 58499 25865250 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:11:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:11:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:11:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:11:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:11:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:11:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:11:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:11:20 [DEBUG   ] Finished updating board flags in 1.478 seconds
2019-01-16 07:11:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:11:37 [DEBUG   ] Got command RPT from MCS: ref #1183681
2019-01-16 07:11:37 [DEBUG   ] summary = ERROR
2019-01-16 07:11:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183681  13 58499 25897893 A  ERRORERROR'
2019-01-16 07:11:38 [DEBUG   ] Got command RPT from MCS: ref #1183682
2019-01-16 07:11:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:11:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183682  77 58499 25898097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:11:38 [DEBUG   ] Got command RPT from MCS: ref #1183683
2019-01-16 07:11:38 [DEBUG   ] summary = ERROR
2019-01-16 07:11:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183683  13 58499 25898301 A  ERRORERROR'
2019-01-16 07:11:38 [DEBUG   ] Got command RPT from MCS: ref #1183684
2019-01-16 07:11:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:11:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183684  77 58499 25898493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:11:38 [DEBUG   ] Got command RPT from MCS: ref #1183685
2019-01-16 07:11:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 07:11:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183685  12 58499 25898697 A  ERRORB˜™š'
2019-01-16 07:11:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 07:12:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 07:12:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:12:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:12:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:12:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:12:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:12:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:12:20 [DEBUG   ] Finished updating board flags in 1.486 seconds
2019-01-16 07:12:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 07:12:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:13:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 07:13:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:13:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-16 07:13:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 07:13:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:13:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:13:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:13:20 [WARNING ] (13, 1, 'bot')
2019-01-16 07:13:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:13:20 [DEBUG   ] Finished updating board flags in 1.551 seconds
2019-01-16 07:13:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 07:13:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:14:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:14:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:14:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:14:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:14:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:14:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:14:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:14:21 [DEBUG   ] Finished updating board flags in 2.209 seconds
2019-01-16 07:14:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-16 07:14:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 07:15:08 [DEBUG   ] Finished updating ant stats in 0.613 seconds
2019-01-16 07:15:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:15:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:15:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:15:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:15:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:15:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:15:21 [DEBUG   ] Finished updating board flags in 2.086 seconds
2019-01-16 07:15:28 [DEBUG   ] Finished updating ant stats in 0.589 seconds
2019-01-16 07:15:48 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 07:16:05 [DEBUG   ] Got command RPT from MCS: ref #1183694
2019-01-16 07:16:05 [DEBUG   ] summary = ERROR
2019-01-16 07:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183694  13 58499 26165245 A  ERRORERROR'
2019-01-16 07:16:05 [DEBUG   ] Got command RPT from MCS: ref #1183695
2019-01-16 07:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183695  77 58499 26165246 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:16:09 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-16 07:16:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:16:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:16:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:16:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:16:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:16:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:16:21 [DEBUG   ] Finished updating board flags in 2.022 seconds
2019-01-16 07:16:29 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-16 07:16:37 [DEBUG   ] Got command RPT from MCS: ref #1183713
2019-01-16 07:16:37 [DEBUG   ] summary = ERROR
2019-01-16 07:16:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183713  13 58499 26197977 A  ERRORERROR'
2019-01-16 07:16:38 [DEBUG   ] Got command RPT from MCS: ref #1183714
2019-01-16 07:16:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:16:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183714  77 58499 26198181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:16:38 [DEBUG   ] Got command RPT from MCS: ref #1183715
2019-01-16 07:16:38 [DEBUG   ] summary = ERROR
2019-01-16 07:16:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183715  13 58499 26198385 A  ERRORERROR'
2019-01-16 07:16:38 [DEBUG   ] Got command RPT from MCS: ref #1183717
2019-01-16 07:16:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:16:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183717  77 58499 26198577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:16:38 [DEBUG   ] Got command RPT from MCS: ref #1183718
2019-01-16 07:16:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 07:16:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183718  12 58499 26198785 A  ERRORB˜™š'
2019-01-16 07:16:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 07:17:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 07:17:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:17:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:17:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:17:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:17:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:17:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:17:21 [DEBUG   ] Finished updating board flags in 1.983 seconds
2019-01-16 07:17:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 07:17:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 07:18:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 07:18:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:18:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:18:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:18:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:18:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:18:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:18:21 [DEBUG   ] Finished updating board flags in 1.829 seconds
2019-01-16 07:18:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 07:18:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 07:19:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 07:19:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:19:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:19:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:19:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:19:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:19:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:19:21 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-01-16 07:19:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 07:19:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 07:20:09 [DEBUG   ] Finished updating ant stats in 1.212 seconds
2019-01-16 07:20:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 07:20:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:20:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 07:20:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:20:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:20:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:20:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:20:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:20:21 [DEBUG   ] Finished updating board flags in 1.822 seconds
2019-01-16 07:20:29 [DEBUG   ] Finished updating ant stats in 1.188 seconds
2019-01-16 07:20:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 07:21:05 [DEBUG   ] Got command RPT from MCS: ref #1183742
2019-01-16 07:21:05 [DEBUG   ] summary = ERROR
2019-01-16 07:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183742  13 58499 26465253 A  ERRORERROR'
2019-01-16 07:21:05 [DEBUG   ] Got command RPT from MCS: ref #1183743
2019-01-16 07:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183743  77 58499 26465254 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:21:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 07:21:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:21:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:21:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:21:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:21:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:21:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:21:21 [DEBUG   ] Finished updating board flags in 1.748 seconds
2019-01-16 07:21:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 07:21:38 [DEBUG   ] Got command RPT from MCS: ref #1183759
2019-01-16 07:21:38 [DEBUG   ] summary = ERROR
2019-01-16 07:21:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183759  13 58499 26498061 A  ERRORERROR'
2019-01-16 07:21:38 [DEBUG   ] Got command RPT from MCS: ref #1183760
2019-01-16 07:21:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:21:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183760  77 58499 26498265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:21:38 [DEBUG   ] Got command RPT from MCS: ref #1183761
2019-01-16 07:21:38 [DEBUG   ] summary = ERROR
2019-01-16 07:21:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183761  13 58499 26498469 A  ERRORERROR'
2019-01-16 07:21:38 [DEBUG   ] Got command RPT from MCS: ref #1183762
2019-01-16 07:21:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:21:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183762  77 58499 26498661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:21:38 [DEBUG   ] Got command RPT from MCS: ref #1183763
2019-01-16 07:21:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 07:21:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183763  12 58499 26498865 A  ERRORB˜™š'
2019-01-16 07:21:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 07:22:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 07:22:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 07:22:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:22:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:22:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:22:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:22:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:22:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:22:21 [DEBUG   ] Finished updating board flags in 1.690 seconds
2019-01-16 07:22:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 07:22:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 07:23:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-16 07:23:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:23:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:23:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:23:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:23:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:23:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:23:21 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-01-16 07:23:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 07:23:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 07:24:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 07:24:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:24:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:24:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:24:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:24:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:24:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:24:21 [DEBUG   ] Finished updating board flags in 1.495 seconds
2019-01-16 07:24:29 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-01-16 07:24:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:25:09 [DEBUG   ] Finished updating ant stats in 0.816 seconds
2019-01-16 07:25:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:25:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:25:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:25:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:25:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:25:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:25:21 [DEBUG   ] Finished updating board flags in 1.468 seconds
2019-01-16 07:25:29 [DEBUG   ] Finished updating ant stats in 0.790 seconds
2019-01-16 07:25:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 07:26:05 [DEBUG   ] Got command RPT from MCS: ref #1183768
2019-01-16 07:26:05 [DEBUG   ] summary = ERROR
2019-01-16 07:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183768  13 58499 26765253 A  ERRORERROR'
2019-01-16 07:26:05 [DEBUG   ] Got command RPT from MCS: ref #1183769
2019-01-16 07:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183769  77 58499 26765254 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:26:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 07:26:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:26:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:26:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:26:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:26:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:26:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:26:21 [DEBUG   ] Finished updating board flags in 1.463 seconds
2019-01-16 07:26:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 07:26:38 [DEBUG   ] Got command RPT from MCS: ref #1183787
2019-01-16 07:26:38 [DEBUG   ] summary = ERROR
2019-01-16 07:26:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183787  13 58499 26798145 A  ERRORERROR'
2019-01-16 07:26:38 [DEBUG   ] Got command RPT from MCS: ref #1183788
2019-01-16 07:26:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:26:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183788  77 58499 26798349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:26:38 [DEBUG   ] Got command RPT from MCS: ref #1183789
2019-01-16 07:26:38 [DEBUG   ] summary = ERROR
2019-01-16 07:26:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183789  13 58499 26798553 A  ERRORERROR'
2019-01-16 07:26:38 [DEBUG   ] Got command RPT from MCS: ref #1183791
2019-01-16 07:26:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:26:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183791  77 58499 26798745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:26:38 [DEBUG   ] Got command RPT from MCS: ref #1183792
2019-01-16 07:26:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 07:26:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183792  12 58499 26798949 A  ERRORB˜™š'
2019-01-16 07:26:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 07:27:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 07:27:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:27:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 07:27:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:27:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:27:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:27:21 [WARNING ] (13, 1, 'bot')
2019-01-16 07:27:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:27:21 [DEBUG   ] Finished updating board flags in 1.500 seconds
2019-01-16 07:27:29 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-16 07:27:50 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-16 07:28:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-16 07:28:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:28:22 [WARNING ] (13, 1, 'bot')
2019-01-16 07:28:22 [WARNING ] (13, 1, 'bot')
2019-01-16 07:28:22 [WARNING ] (13, 1, 'bot')
2019-01-16 07:28:22 [WARNING ] (13, 1, 'bot')
2019-01-16 07:28:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:28:22 [DEBUG   ] Finished updating board flags in 2.219 seconds
2019-01-16 07:28:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 07:28:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 07:29:10 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-16 07:29:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:29:22 [WARNING ] (13, 1, 'bot')
2019-01-16 07:29:22 [WARNING ] (13, 1, 'bot')
2019-01-16 07:29:22 [WARNING ] (13, 1, 'bot')
2019-01-16 07:29:22 [WARNING ] (13, 1, 'bot')
2019-01-16 07:29:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:29:22 [DEBUG   ] Finished updating board flags in 2.175 seconds
2019-01-16 07:29:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 07:29:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 07:30:10 [DEBUG   ] Finished updating ant stats in 1.214 seconds
2019-01-16 07:30:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:30:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 07:30:22 [WARNING ] (13, 1, 'bot')
2019-01-16 07:30:22 [WARNING ] (13, 1, 'bot')
2019-01-16 07:30:22 [WARNING ] (13, 1, 'bot')
2019-01-16 07:30:22 [WARNING ] (13, 1, 'bot')
2019-01-16 07:30:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:30:22 [DEBUG   ] Finished updating board flags in 2.018 seconds
2019-01-16 07:30:30 [DEBUG   ] Finished updating ant stats in 1.189 seconds
2019-01-16 07:30:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 07:31:00 [DEBUG   ] Got command RPT from MCS: ref #1183805
2019-01-16 07:31:00 [DEBUG   ] summary = ERROR
2019-01-16 07:31:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183805  13 58499 27060493 A  ERRORERROR'
2019-01-16 07:31:00 [DEBUG   ] Got command RPT from MCS: ref #1183806
2019-01-16 07:31:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:31:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183806  77 58499 27060494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:31:05 [DEBUG   ] Got command RPT from MCS: ref #1183807
2019-01-16 07:31:05 [DEBUG   ] summary = ERROR
2019-01-16 07:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183807  13 58499 27065257 A  ERRORERROR'
2019-01-16 07:31:05 [DEBUG   ] Got command RPT from MCS: ref #1183808
2019-01-16 07:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183808  77 58499 27065258 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:31:05 [DEBUG   ] Got command INI from MCS: ref #1183824
2019-01-16 07:31:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2019-01-16 07:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI  1183824   8 58499 27065514 ABOOTING'
2019-01-16 07:31:09 [WARNING ] AntennaStats: no access to lwa28
2019-01-16 07:31:09 [WARNING ] AntennaStats: last command was /usr/local/bin/lwa28 /lwa/software/amplitude
2019-01-16 07:31:09 [WARNING ] AntennaStats: last command output as 
2019-01-16 07:31:09 [DEBUG   ] Finished updating ant stats in 0.427 seconds
2019-01-16 07:31:29 [INFO    ] -------------------
2019-01-16 07:31:29 [INFO    ]  LWA board status
2019-01-16 07:31:29 [INFO    ] -------------------
2019-01-16 07:31:29 [INFO    ] DP 1: 2 lwa27
2019-01-16 07:31:29 [INFO    ] DP 1: 3 lwa24
2019-01-16 07:31:29 [INFO    ] DP 1: 4 lwa23
2019-01-16 07:31:29 [INFO    ] DP 1: 5 lwa18
2019-01-16 07:31:29 [INFO    ] DP 1: 6 lwa10
2019-01-16 07:31:29 [INFO    ] DP 1: 7 lwa32
2019-01-16 07:31:29 [INFO    ] DP 1: 8 lwa11
2019-01-16 07:31:29 [INFO    ] DP 1: 9 lwa30
2019-01-16 07:31:29 [INFO    ] DP 1: 10 lwa12
2019-01-16 07:31:29 [INFO    ] DP 1: 11 lwa8
2019-01-16 07:31:29 [INFO    ] DP 1: 12 lwa13
2019-01-16 07:31:29 [INFO    ] DP 1: 13 lwa26
2019-01-16 07:31:29 [INFO    ] DP 1: 14 lwa14
2019-01-16 07:31:29 [INFO    ] DP 1: 16 lwa22
2019-01-16 07:31:29 [INFO    ] DP 1: 17 lwa20
2019-01-16 07:31:29 [INFO    ] DP 1: 18 lwa1
2019-01-16 07:31:29 [INFO    ] DP 1: 19 lwa5
2019-01-16 07:31:29 [INFO    ] DP 1: 20 lwa25
2019-01-16 07:31:29 [INFO    ] DP 1: 21 lwa35
2019-01-16 07:31:29 [INFO    ] DP 1: 22 lwa19
2019-01-16 07:31:29 [INFO    ] DP 1: 23 lwa21
2019-01-16 07:31:29 [INFO    ] DP 1: 24 lwa6
2019-01-16 07:31:29 [INFO    ] DP 1: 25 lwa7
2019-01-16 07:31:29 [INFO    ] DP 1: 26 lwa33
2019-01-16 07:31:29 [INFO    ] DP 1: 27 lwa15
2019-01-16 07:31:29 [INFO    ] DP 1: 28 lwa28
2019-01-16 07:31:29 [INFO    ] DP 2: 1 lwa16
2019-01-16 07:31:29 [INFO    ] DP 2: 15 lwa34
2019-01-16 07:31:29 [INFO    ] Total of 28 boards
2019-01-16 07:31:29 [INFO    ] Total of 260 stands
2019-01-16 07:31:29 [INFO    ] -------------------
2019-01-16 07:31:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16154
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16155
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16156
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16157
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16158
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16159
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16160
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16161
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16162
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16163
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16164
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16165
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16166
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16167
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16168
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16169
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16170
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16171
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16172
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16173
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16174
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16175
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16176
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16177
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16178
2019-01-16 07:31:36 [DEBUG   ] 2019-01-16 07:31:36 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16179
2019-01-16 07:31:38 [DEBUG   ] Got command RPT from MCS: ref #1183825
2019-01-16 07:31:38 [DEBUG   ] summary = BOOTING
2019-01-16 07:31:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183825  15 58499 27098233 ABOOTINGBOOTING'
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16154 exited with status 0
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16155 exited with status 0
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16156 exited with status 0
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16157 exited with status 0
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16158 exited with status 0
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16159 exited with status 0
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16160 exited with status 0
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16161 exited with status 0
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16162 exited with status 0
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16163 exited with status 0
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16164 exited with status 0
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16165 exited with status 0
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16166 exited with status 0
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16167 exited with status 0
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16168 exited with status 0
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16169 exited with status 0
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16170 exited with status 0
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16171 exited with status 0
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16172 exited with status 0
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16173 exited with status 0
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16174 exited with status 0
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16175 exited with status 0
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16176 exited with status 0
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16177 exited with status 0
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16178 exited with status 0
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16179 exited with status 0
2019-01-16 07:31:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] spawn_process: at 2019-01-16 07:31:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 16206
2019-01-16 07:31:49 [DEBUG   ] 2019-01-16 07:31:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 16207
2019-01-16 07:31:54 [DEBUG   ] 2019-01-16 07:31:54 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 16206 exited with status 0
2019-01-16 07:31:54 [DEBUG   ] 2019-01-16 07:31:54 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 16207 exited with status 0
2019-01-16 07:31:54 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2019-01-16 07:31:54 [DEBUG   ] spawn_process: at 2019-01-16 07:31:54 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2019-01-16 07:31:54 [DEBUG   ] spawn_process: at 2019-01-16 07:31:54 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2019-01-16 07:31:54 [INFO    ] Setting Beam 1 xbars
2019-01-16 07:31:54 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2019-01-16 07:31:54 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2019-01-16 07:31:55 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2019-01-16 07:31:55 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2019-01-16 07:31:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2019-01-16 07:31:55 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2019-01-16 07:31:55 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2019-01-16 07:31:55 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2019-01-16 07:31:55 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2019-01-16 07:31:55 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2019-01-16 07:31:55 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2019-01-16 07:31:55 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2019-01-16 07:31:56 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2019-01-16 07:31:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2019-01-16 07:31:56 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2019-01-16 07:31:56 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2019-01-16 07:31:56 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2019-01-16 07:31:56 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2019-01-16 07:31:56 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2019-01-16 07:31:56 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2019-01-16 07:31:56 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2019-01-16 07:31:57 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2019-01-16 07:31:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2019-01-16 07:31:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2019-01-16 07:31:57 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2019-01-16 07:31:57 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2019-01-16 07:31:57 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2019-01-16 07:31:57 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2019-01-16 07:31:57 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2019-01-16 07:31:57 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2019-01-16 07:31:58 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2019-01-16 07:31:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2019-01-16 07:31:58 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2019-01-16 07:31:58 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2019-01-16 07:31:58 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2019-01-16 07:31:58 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2019-01-16 07:31:58 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2019-01-16 07:31:58 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2019-01-16 07:31:58 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2019-01-16 07:31:59 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2019-01-16 07:31:59 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2019-01-16 07:31:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2019-01-16 07:31:59 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2019-01-16 07:31:59 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2019-01-16 07:31:59 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2019-01-16 07:31:59 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2019-01-16 07:31:59 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2019-01-16 07:31:59 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2019-01-16 07:32:00 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2019-01-16 07:32:00 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2019-01-16 07:32:00 [INFO    ] Setting Beam 2 xbars
2019-01-16 07:32:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2019-01-16 07:32:00 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2019-01-16 07:32:00 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2019-01-16 07:32:00 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2019-01-16 07:32:00 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2019-01-16 07:32:00 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2019-01-16 07:32:00 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2019-01-16 07:32:00 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2019-01-16 07:32:01 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2019-01-16 07:32:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2019-01-16 07:32:01 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2019-01-16 07:32:01 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2019-01-16 07:32:01 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2019-01-16 07:32:01 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2019-01-16 07:32:01 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2019-01-16 07:32:01 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2019-01-16 07:32:01 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2019-01-16 07:32:02 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2019-01-16 07:32:02 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2019-01-16 07:32:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2019-01-16 07:32:02 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2019-01-16 07:32:02 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2019-01-16 07:32:02 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2019-01-16 07:32:02 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2019-01-16 07:32:02 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2019-01-16 07:32:02 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2019-01-16 07:32:03 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2019-01-16 07:32:03 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2019-01-16 07:32:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2019-01-16 07:32:03 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2019-01-16 07:32:03 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2019-01-16 07:32:03 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2019-01-16 07:32:03 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2019-01-16 07:32:03 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2019-01-16 07:32:03 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2019-01-16 07:32:03 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2019-01-16 07:32:04 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2019-01-16 07:32:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2019-01-16 07:32:04 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2019-01-16 07:32:04 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2019-01-16 07:32:04 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2019-01-16 07:32:04 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2019-01-16 07:32:04 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2019-01-16 07:32:04 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2019-01-16 07:32:04 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2019-01-16 07:32:05 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2019-01-16 07:32:05 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2019-01-16 07:32:05 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2019-01-16 07:32:05 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2019-01-16 07:32:05 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2019-01-16 07:32:05 [INFO    ] Setting Beam 3 xbars
2019-01-16 07:32:05 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2019-01-16 07:32:05 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2019-01-16 07:32:05 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2019-01-16 07:32:05 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2019-01-16 07:32:06 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2019-01-16 07:32:06 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2019-01-16 07:32:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2019-01-16 07:32:06 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2019-01-16 07:32:06 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2019-01-16 07:32:06 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2019-01-16 07:32:06 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2019-01-16 07:32:06 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2019-01-16 07:32:06 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2019-01-16 07:32:07 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2019-01-16 07:32:07 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2019-01-16 07:32:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2019-01-16 07:32:07 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2019-01-16 07:32:07 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2019-01-16 07:32:07 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2019-01-16 07:32:07 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2019-01-16 07:32:07 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2019-01-16 07:32:07 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2019-01-16 07:32:08 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2019-01-16 07:32:08 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2019-01-16 07:32:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2019-01-16 07:32:08 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2019-01-16 07:32:08 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2019-01-16 07:32:08 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2019-01-16 07:32:08 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2019-01-16 07:32:08 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2019-01-16 07:32:08 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2019-01-16 07:32:09 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2019-01-16 07:32:09 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2019-01-16 07:32:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2019-01-16 07:32:09 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2019-01-16 07:32:09 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2019-01-16 07:32:09 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2019-01-16 07:32:09 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2019-01-16 07:32:09 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2019-01-16 07:32:09 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2019-01-16 07:32:09 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2019-01-16 07:32:10 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2019-01-16 07:32:10 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2019-01-16 07:32:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2019-01-16 07:32:10 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2019-01-16 07:32:10 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2019-01-16 07:32:10 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2019-01-16 07:32:10 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2019-01-16 07:32:10 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2019-01-16 07:32:10 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2019-01-16 07:32:11 [INFO    ] Setting Beam 4 xbars
2019-01-16 07:32:11 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2019-01-16 07:32:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-01-16 07:32:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-01-16 07:32:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-01-16 07:32:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-01-16 07:32:11 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2019-01-16 07:32:11 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2019-01-16 07:32:11 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2019-01-16 07:32:11 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2019-01-16 07:32:12 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2019-01-16 07:32:12 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2019-01-16 07:32:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2019-01-16 07:32:12 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2019-01-16 07:32:12 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2019-01-16 07:32:12 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2019-01-16 07:32:12 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2019-01-16 07:32:12 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2019-01-16 07:32:12 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2019-01-16 07:32:13 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2019-01-16 07:32:13 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2019-01-16 07:32:13 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2019-01-16 07:32:13 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2019-01-16 07:32:13 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2019-01-16 07:32:13 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2019-01-16 07:32:13 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2019-01-16 07:32:13 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2019-01-16 07:32:13 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2019-01-16 07:32:14 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2019-01-16 07:32:14 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2019-01-16 07:32:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2019-01-16 07:32:14 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2019-01-16 07:32:14 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2019-01-16 07:32:14 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2019-01-16 07:32:14 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2019-01-16 07:32:14 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2019-01-16 07:32:14 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2019-01-16 07:32:15 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2019-01-16 07:32:15 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2019-01-16 07:32:15 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2019-01-16 07:32:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2019-01-16 07:32:15 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2019-01-16 07:32:15 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2019-01-16 07:32:15 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2019-01-16 07:32:15 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2019-01-16 07:32:15 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2019-01-16 07:32:15 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2019-01-16 07:32:16 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2019-01-16 07:32:16 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2019-01-16 07:32:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2019-01-16 07:32:16 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2019-01-16 07:32:16 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2019-01-16 07:32:16 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2019-01-16 07:32:16 [INFO    ] All xbars set
2019-01-16 07:32:16 [INFO    ] Setting adder chain routing for all beams
2019-01-16 07:32:21 [INFO    ] Setting beam ids
2019-01-16 07:32:31 [INFO    ] Starting beam delay calibration
2019-01-16 07:32:43 [INFO    ] Beam 1 latency is 5716
2019-01-16 07:32:43 [INFO    ] Beam 2 latency is 5723
2019-01-16 07:32:43 [INFO    ] Beam 3 latency is 5720
2019-01-16 07:32:43 [INFO    ] Beam 4 latency is 5720
2019-01-16 07:32:43 [INFO    ] Stop calibration
2019-01-16 07:32:51 [INFO    ] Beam delay calibration successful
2019-01-16 07:32:51 [INFO    ] Calibration passed
2019-01-16 07:32:51 [DEBUG   ] spawn_process: at 2019-01-16 07:32:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2019-01-16 07:32:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2019-01-16 07:32:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2019-01-16 07:32:51 [DEBUG   ] spawn_process: at 2019-01-16 07:32:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2019-01-16 07:32:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2019-01-16 07:32:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2019-01-16 07:32:51 [DEBUG   ] spawn_process: at 2019-01-16 07:32:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2019-01-16 07:32:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2019-01-16 07:32:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2019-01-16 07:32:51 [DEBUG   ] spawn_process: at 2019-01-16 07:32:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2019-01-16 07:32:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2019-01-16 07:32:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2019-01-16 07:32:51 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2019-01-16 07:32:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 271 ms (1547623972.273 s) with PID 17783 and time 1547623973
2019-01-16 07:32:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2019-01-16 07:32:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 361 ms (1547623972.362 s) with PID 17786 and time 1547623973
2019-01-16 07:32:53 [DEBUG   ] Finished updating ant stats in 0.884 seconds
2019-01-16 07:32:53 [INFO    ] Started antennas statistics background thread
2019-01-16 07:32:53 [INFO    ] Started board flags background thread
2019-01-16 07:32:53 [INFO    ] Started BAM background thread
2019-01-16 07:32:53 [INFO    ] Finished the INI process (ref. #1183824) in 107.972 s
2019-01-16 07:32:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:32:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:32:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:32:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:32:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:32:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:32:54 [DEBUG   ] Finished updating board flags in 1.064 seconds
2019-01-16 07:33:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:33:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:33:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 07:33:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:33:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:33:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:33:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:33:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:33:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:33:54 [DEBUG   ] Finished updating board flags in 1.011 seconds
2019-01-16 07:34:05 [DEBUG   ] Got command RPT from MCS: ref #1183830
2019-01-16 07:34:05 [DEBUG   ] summary = ERROR
2019-01-16 07:34:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183830  13 58499 27245509 A  ERRORERROR'
2019-01-16 07:34:05 [DEBUG   ] Got command RPT from MCS: ref #1183831
2019-01-16 07:34:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:34:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183831  77 58499 27245510 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:34:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:34:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:34:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:34:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:34:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 07:34:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:34:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:34:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:34:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:34:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:34:54 [DEBUG   ] Finished updating board flags in 1.007 seconds
2019-01-16 07:35:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 07:35:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:35:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:35:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:35:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:35:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:35:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:35:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:35:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:35:54 [DEBUG   ] Finished updating board flags in 1.014 seconds
2019-01-16 07:36:05 [DEBUG   ] Got command RPT from MCS: ref #1183836
2019-01-16 07:36:05 [DEBUG   ] summary = ERROR
2019-01-16 07:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183836  13 58499 27365249 A  ERRORERROR'
2019-01-16 07:36:05 [DEBUG   ] Got command RPT from MCS: ref #1183837
2019-01-16 07:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183837  77 58499 27365250 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:36:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:36:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:36:38 [DEBUG   ] Got command RPT from MCS: ref #1183855
2019-01-16 07:36:38 [DEBUG   ] summary = ERROR
2019-01-16 07:36:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183855  13 58499 27398313 A  ERRORERROR'
2019-01-16 07:36:38 [DEBUG   ] Got command RPT from MCS: ref #1183856
2019-01-16 07:36:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:36:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183856  77 58499 27398517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:36:38 [DEBUG   ] Got command RPT from MCS: ref #1183857
2019-01-16 07:36:38 [DEBUG   ] summary = ERROR
2019-01-16 07:36:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183857  13 58499 27398721 A  ERRORERROR'
2019-01-16 07:36:38 [DEBUG   ] Got command RPT from MCS: ref #1183858
2019-01-16 07:36:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:36:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183858  77 58499 27398913 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:36:39 [DEBUG   ] Got command RPT from MCS: ref #1183860
2019-01-16 07:36:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 07:36:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183860  12 58499 27399117 A  ERRORB˜™š'
2019-01-16 07:36:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:36:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:36:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:36:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:36:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:36:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:36:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:36:55 [DEBUG   ] Finished updating board flags in 2.051 seconds
2019-01-16 07:37:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:37:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:37:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:37:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:37:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:37:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:37:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:37:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:37:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:37:54 [DEBUG   ] Finished updating board flags in 1.384 seconds
2019-01-16 07:38:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:38:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:38:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:38:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:38:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:38:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:38:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:38:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:38:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:38:54 [DEBUG   ] Finished updating board flags in 1.238 seconds
2019-01-16 07:39:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 07:39:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:39:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 07:39:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:39:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:39:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:39:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:39:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:39:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:39:54 [DEBUG   ] Finished updating board flags in 1.177 seconds
2019-01-16 07:40:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 07:40:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:40:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:40:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:40:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:40:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:40:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:40:54 [WARNING ] (13, 1, 'bot')
2019-01-16 07:40:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:40:54 [DEBUG   ] Finished updating board flags in 1.023 seconds
2019-01-16 07:41:05 [DEBUG   ] Got command RPT from MCS: ref #1183869
2019-01-16 07:41:05 [DEBUG   ] summary = ERROR
2019-01-16 07:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183869  13 58499 27665249 A  ERRORERROR'
2019-01-16 07:41:05 [DEBUG   ] Got command RPT from MCS: ref #1183870
2019-01-16 07:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183870  77 58499 27665250 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:41:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:41:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:41:38 [DEBUG   ] Got command RPT from MCS: ref #1183886
2019-01-16 07:41:38 [DEBUG   ] summary = ERROR
2019-01-16 07:41:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183886  13 58499 27698405 A  ERRORERROR'
2019-01-16 07:41:38 [DEBUG   ] Got command RPT from MCS: ref #1183887
2019-01-16 07:41:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:41:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183887  77 58499 27698597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:41:38 [DEBUG   ] Got command RPT from MCS: ref #1183888
2019-01-16 07:41:38 [DEBUG   ] summary = ERROR
2019-01-16 07:41:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183888  13 58499 27698801 A  ERRORERROR'
2019-01-16 07:41:39 [DEBUG   ] Got command RPT from MCS: ref #1183889
2019-01-16 07:41:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:41:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183889  77 58499 27699005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:41:39 [DEBUG   ] Got command RPT from MCS: ref #1183890
2019-01-16 07:41:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 07:41:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183890  12 58499 27699209 A  ERRORB˜™š'
2019-01-16 07:41:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:41:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2019-01-16 07:41:54 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 07:41:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:41:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:41:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:41:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:41:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:41:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:41:55 [DEBUG   ] Finished updating board flags in 1.656 seconds
2019-01-16 07:42:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:42:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:42:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:42:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:42:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:42:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:42:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:42:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:42:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:42:55 [DEBUG   ] Finished updating board flags in 1.469 seconds
2019-01-16 07:43:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:43:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:43:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:43:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 07:43:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:43:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:43:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:43:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:43:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:43:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:43:55 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-01-16 07:44:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:44:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:44:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:44:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 07:44:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:44:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-16 07:44:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 07:44:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:44:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:44:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:44:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:44:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:44:55 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-01-16 07:45:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:45:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:45:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 07:45:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-16 07:45:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:45:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 07:45:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:45:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:45:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:45:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:45:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:45:55 [DEBUG   ] Finished updating board flags in 1.374 seconds
2019-01-16 07:46:05 [DEBUG   ] Got command RPT from MCS: ref #1183899
2019-01-16 07:46:05 [DEBUG   ] summary = ERROR
2019-01-16 07:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183899  13 58499 27965261 A  ERRORERROR'
2019-01-16 07:46:05 [DEBUG   ] Got command RPT from MCS: ref #1183900
2019-01-16 07:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183900  77 58499 27965262 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:46:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 07:46:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:46:38 [DEBUG   ] Got command RPT from MCS: ref #1183918
2019-01-16 07:46:38 [DEBUG   ] summary = ERROR
2019-01-16 07:46:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183918  13 58499 27998481 A  ERRORERROR'
2019-01-16 07:46:38 [DEBUG   ] Got command RPT from MCS: ref #1183919
2019-01-16 07:46:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:46:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183919  77 58499 27998685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:46:38 [DEBUG   ] Got command RPT from MCS: ref #1183920
2019-01-16 07:46:38 [DEBUG   ] summary = ERROR
2019-01-16 07:46:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183920  13 58499 27998889 A  ERRORERROR'
2019-01-16 07:46:39 [DEBUG   ] Got command RPT from MCS: ref #1183921
2019-01-16 07:46:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:46:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183921  77 58499 27999093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:46:39 [DEBUG   ] Got command RPT from MCS: ref #1183923
2019-01-16 07:46:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 07:46:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183923  12 58499 27999285 A  ERRORB˜™š'
2019-01-16 07:46:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:46:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:46:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 07:46:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:46:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:46:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:46:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:46:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:46:55 [DEBUG   ] Finished updating board flags in 1.284 seconds
2019-01-16 07:47:13 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-16 07:47:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 07:47:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 07:47:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:47:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:47:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:47:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:47:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:47:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:47:55 [DEBUG   ] Finished updating board flags in 1.125 seconds
2019-01-16 07:48:13 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-01-16 07:48:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-16 07:48:53 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-16 07:48:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:48:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 07:48:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:48:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:48:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:48:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:48:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:48:55 [DEBUG   ] Finished updating board flags in 1.005 seconds
2019-01-16 07:49:13 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-16 07:49:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-16 07:49:53 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-16 07:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:49:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:49:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:49:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:49:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:49:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:49:55 [DEBUG   ] Finished updating board flags in 0.991 seconds
2019-01-16 07:50:13 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2019-01-16 07:50:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 07:50:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 07:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:50:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:50:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:50:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:50:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:50:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:50:55 [DEBUG   ] Finished updating board flags in 1.282 seconds
2019-01-16 07:51:05 [DEBUG   ] Got command RPT from MCS: ref #1183936
2019-01-16 07:51:05 [DEBUG   ] summary = ERROR
2019-01-16 07:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183936  13 58499 28265261 A  ERRORERROR'
2019-01-16 07:51:05 [DEBUG   ] Got command RPT from MCS: ref #1183937
2019-01-16 07:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183937  77 58499 28265262 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:51:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 07:51:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 07:51:38 [DEBUG   ] Got command RPT from MCS: ref #1183957
2019-01-16 07:51:38 [DEBUG   ] summary = ERROR
2019-01-16 07:51:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183957  13 58499 28298573 A  ERRORERROR'
2019-01-16 07:51:38 [DEBUG   ] Got command RPT from MCS: ref #1183958
2019-01-16 07:51:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:51:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183958  77 58499 28298777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:51:38 [DEBUG   ] Got command RPT from MCS: ref #1183959
2019-01-16 07:51:38 [DEBUG   ] summary = ERROR
2019-01-16 07:51:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183959  13 58499 28298969 A  ERRORERROR'
2019-01-16 07:51:39 [DEBUG   ] Got command RPT from MCS: ref #1183960
2019-01-16 07:51:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:51:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183960  77 58499 28299173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:51:39 [DEBUG   ] Got command RPT from MCS: ref #1183961
2019-01-16 07:51:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 07:51:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183961  12 58499 28299377 A  ERRORB™™š'
2019-01-16 07:51:41 [DEBUG   ] Got command DRX from MCS: ref #1183963
2019-01-16 07:51:41 [INFO    ] sending drx command to lwa16
2019-01-16 07:51:41 [DEBUG   ] run_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 1 64500000.0 7 9 0']
2019-01-16 07:51:41 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-16 07:51:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1183963   8 58499 28301013 A  ERROR'
2019-01-16 07:51:41 [DEBUG   ] Got command DRX from MCS: ref #1183962
2019-01-16 07:51:41 [INFO    ] sending drx command to lwa16
2019-01-16 07:51:41 [DEBUG   ] run_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 35100000.0 7 9 0']
2019-01-16 07:51:41 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-16 07:51:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1183962   8 58499 28301017 A  ERROR'
2019-01-16 07:51:41 [DEBUG   ] Got command DRX from MCS: ref #1183964
2019-01-16 07:51:41 [INFO    ] sending drx command to lwa16
2019-01-16 07:51:41 [DEBUG   ] run_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 49800000.0 7 9 0']
2019-01-16 07:51:41 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-16 07:51:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1183964   8 58499 28301021 A  ERROR'
2019-01-16 07:51:41 [DEBUG   ] Got command DRX from MCS: ref #1183965
2019-01-16 07:51:41 [INFO    ] sending drx command to lwa16
2019-01-16 07:51:41 [DEBUG   ] run_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 2 79200000.0 7 9 0']
2019-01-16 07:51:41 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-16 07:51:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1183965   8 58499 28301025 A  ERROR'
2019-01-16 07:51:41 [DEBUG   ] Got command BAM from MCS: ref #1183966
2019-01-16 07:51:41 [INFO    ] Finished processing BAM request
2019-01-16 07:51:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:51:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1183966   8 58499 28301029 A  ERROR'
2019-01-16 07:51:41 [DEBUG   ] Got command BAM from MCS: ref #1183967
2019-01-16 07:51:41 [INFO    ] Finished processing BAM request
2019-01-16 07:51:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:51:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1183967   8 58499 28301033 A  ERROR'
2019-01-16 07:51:41 [INFO    ] Finished starting DRX
2019-01-16 07:51:41 [INFO    ] Finished starting DRX
2019-01-16 07:51:41 [INFO    ] Finished starting DRX
2019-01-16 07:51:41 [INFO    ] Finished starting DRX
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 07:51:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 07:51:41 [DEBUG   ] spawn_process: at 2019-01-16 07:51:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 07:51:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 07:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:51:55 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 07:51:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 07:51:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:51:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:51:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:51:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:51:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:51:55 [DEBUG   ] Finished updating board flags in 1.167 seconds
2019-01-16 07:52:04 [DEBUG   ] Got command BAM from MCS: ref #1183971
2019-01-16 07:52:04 [INFO    ] Finished processing BAM request
2019-01-16 07:52:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:52:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1183971   8 58499 28324029 A  ERROR'
2019-01-16 07:52:04 [DEBUG   ] Got command BAM from MCS: ref #1183970
2019-01-16 07:52:04 [INFO    ] Finished processing BAM request
2019-01-16 07:52:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:52:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1183970   8 58499 28324033 A  ERROR'
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 07:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 07:52:04 [DEBUG   ] spawn_process: at 2019-01-16 07:52:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 07:52:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 07:52:27 [DEBUG   ] Got command BAM from MCS: ref #1183972
2019-01-16 07:52:27 [INFO    ] Finished processing BAM request
2019-01-16 07:52:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:52:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1183972   8 58499 28347033 A  ERROR'
2019-01-16 07:52:27 [DEBUG   ] Got command BAM from MCS: ref #1183973
2019-01-16 07:52:27 [INFO    ] Finished processing BAM request
2019-01-16 07:52:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:52:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1183973   8 58499 28347037 A  ERROR'
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 07:52:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 07:52:27 [DEBUG   ] spawn_process: at 2019-01-16 07:52:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 07:52:34 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-16 07:52:50 [DEBUG   ] Got command BAM from MCS: ref #1183975
2019-01-16 07:52:50 [INFO    ] Finished processing BAM request
2019-01-16 07:52:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:52:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1183975   8 58499 28370029 A  ERROR'
2019-01-16 07:52:50 [DEBUG   ] Got command BAM from MCS: ref #1183974
2019-01-16 07:52:50 [INFO    ] Finished processing BAM request
2019-01-16 07:52:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:52:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1183974   8 58499 28370033 A  ERROR'
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 07:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 07:52:50 [DEBUG   ] spawn_process: at 2019-01-16 07:52:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 07:52:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 07:52:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 07:52:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-16 07:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:52:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-16 07:52:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:52:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:52:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:52:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:52:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:52:55 [DEBUG   ] Finished updating board flags in 1.013 seconds
2019-01-16 07:53:13 [DEBUG   ] Got command BAM from MCS: ref #1183976
2019-01-16 07:53:13 [INFO    ] Finished processing BAM request
2019-01-16 07:53:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:53:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1183976   8 58499 28393025 A  ERROR'
2019-01-16 07:53:13 [DEBUG   ] Got command BAM from MCS: ref #1183977
2019-01-16 07:53:13 [INFO    ] Finished processing BAM request
2019-01-16 07:53:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:53:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1183977   8 58499 28393029 A  ERROR'
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 07:53:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 07:53:13 [DEBUG   ] spawn_process: at 2019-01-16 07:53:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 07:53:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 07:53:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 07:53:36 [DEBUG   ] Got command BAM from MCS: ref #1183979
2019-01-16 07:53:36 [INFO    ] Finished processing BAM request
2019-01-16 07:53:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:53:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1183979   8 58499 28416029 A  ERROR'
2019-01-16 07:53:36 [DEBUG   ] Got command BAM from MCS: ref #1183978
2019-01-16 07:53:36 [INFO    ] Finished processing BAM request
2019-01-16 07:53:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:53:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1183978   8 58499 28416033 A  ERROR'
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 07:53:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 07:53:36 [DEBUG   ] spawn_process: at 2019-01-16 07:53:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 07:53:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 07:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:53:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:53:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:53:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:53:55 [WARNING ] (13, 1, 'bot')
2019-01-16 07:53:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:53:55 [DEBUG   ] Finished updating board flags in 0.983 seconds
2019-01-16 07:53:59 [DEBUG   ] Got command BAM from MCS: ref #1183985
2019-01-16 07:53:59 [INFO    ] Finished processing BAM request
2019-01-16 07:53:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:53:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1183985   8 58499 28439025 A  ERROR'
2019-01-16 07:53:59 [DEBUG   ] Got command BAM from MCS: ref #1183984
2019-01-16 07:53:59 [INFO    ] Finished processing BAM request
2019-01-16 07:53:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:53:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1183984   8 58499 28439029 A  ERROR'
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 07:53:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 07:53:59 [DEBUG   ] spawn_process: at 2019-01-16 07:53:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 07:54:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 07:54:22 [DEBUG   ] Got command BAM from MCS: ref #1183987
2019-01-16 07:54:22 [INFO    ] Finished processing BAM request
2019-01-16 07:54:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:54:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1183987   8 58499 28462029 A  ERROR'
2019-01-16 07:54:22 [DEBUG   ] Got command BAM from MCS: ref #1183986
2019-01-16 07:54:22 [INFO    ] Finished processing BAM request
2019-01-16 07:54:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:54:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1183986   8 58499 28462033 A  ERROR'
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 07:54:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 07:54:22 [DEBUG   ] spawn_process: at 2019-01-16 07:54:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 07:54:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 07:54:45 [DEBUG   ] Got command BAM from MCS: ref #1183989
2019-01-16 07:54:45 [INFO    ] Finished processing BAM request
2019-01-16 07:54:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:54:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1183989   8 58499 28485029 A  ERROR'
2019-01-16 07:54:45 [DEBUG   ] Got command BAM from MCS: ref #1183988
2019-01-16 07:54:45 [INFO    ] Finished processing BAM request
2019-01-16 07:54:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:54:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1183988   8 58499 28485033 A  ERROR'
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 07:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 07:54:45 [DEBUG   ] spawn_process: at 2019-01-16 07:54:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 07:54:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 07:54:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-16 07:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:54:56 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-16 07:54:56 [WARNING ] (13, 1, 'bot')
2019-01-16 07:54:56 [WARNING ] (13, 1, 'bot')
2019-01-16 07:54:56 [WARNING ] (13, 1, 'bot')
2019-01-16 07:54:56 [WARNING ] (13, 1, 'bot')
2019-01-16 07:54:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:54:56 [DEBUG   ] Finished updating board flags in 1.373 seconds
2019-01-16 07:55:08 [DEBUG   ] Got command BAM from MCS: ref #1183991
2019-01-16 07:55:08 [INFO    ] Finished processing BAM request
2019-01-16 07:55:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:55:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1183991   8 58499 28508025 A  ERROR'
2019-01-16 07:55:08 [DEBUG   ] Got command BAM from MCS: ref #1183990
2019-01-16 07:55:08 [INFO    ] Finished processing BAM request
2019-01-16 07:55:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:55:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1183990   8 58499 28508029 A  ERROR'
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 07:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 07:55:08 [DEBUG   ] spawn_process: at 2019-01-16 07:55:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 07:55:14 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-16 07:55:31 [DEBUG   ] Got command BAM from MCS: ref #1183993
2019-01-16 07:55:31 [INFO    ] Finished processing BAM request
2019-01-16 07:55:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:55:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1183993   8 58499 28531033 A  ERROR'
2019-01-16 07:55:31 [DEBUG   ] Got command BAM from MCS: ref #1183992
2019-01-16 07:55:31 [INFO    ] Finished processing BAM request
2019-01-16 07:55:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:55:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1183992   8 58499 28531037 A  ERROR'
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 07:55:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 07:55:31 [DEBUG   ] spawn_process: at 2019-01-16 07:55:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 07:55:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:55:54 [DEBUG   ] Got command BAM from MCS: ref #1183995
2019-01-16 07:55:54 [INFO    ] Finished processing BAM request
2019-01-16 07:55:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1183995   8 58499 28554033 A  ERROR'
2019-01-16 07:55:54 [DEBUG   ] Got command BAM from MCS: ref #1183994
2019-01-16 07:55:54 [INFO    ] Finished processing BAM request
2019-01-16 07:55:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1183994   8 58499 28554037 A  ERROR'
2019-01-16 07:55:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 07:55:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 07:55:54 [DEBUG   ] spawn_process: at 2019-01-16 07:55:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 07:55:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 07:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:55:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 07:55:56 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-16 07:55:56 [WARNING ] (13, 1, 'bot')
2019-01-16 07:55:56 [WARNING ] (13, 1, 'bot')
2019-01-16 07:55:56 [WARNING ] (13, 1, 'bot')
2019-01-16 07:55:56 [WARNING ] (13, 1, 'bot')
2019-01-16 07:55:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:55:56 [DEBUG   ] Finished updating board flags in 1.188 seconds
2019-01-16 07:56:05 [DEBUG   ] Got command RPT from MCS: ref #1183996
2019-01-16 07:56:05 [DEBUG   ] summary = ERROR
2019-01-16 07:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183996  13 58499 28565253 A  ERRORERROR'
2019-01-16 07:56:05 [DEBUG   ] Got command RPT from MCS: ref #1183997
2019-01-16 07:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1183997  77 58499 28565254 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:56:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:56:17 [DEBUG   ] Got command BAM from MCS: ref #1184014
2019-01-16 07:56:17 [INFO    ] Finished processing BAM request
2019-01-16 07:56:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:56:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184014   8 58499 28577029 A  ERROR'
2019-01-16 07:56:17 [DEBUG   ] Got command BAM from MCS: ref #1184013
2019-01-16 07:56:17 [INFO    ] Finished processing BAM request
2019-01-16 07:56:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:56:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184013   8 58499 28577033 A  ERROR'
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 07:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 07:56:17 [DEBUG   ] spawn_process: at 2019-01-16 07:56:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 07:56:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 07:56:38 [DEBUG   ] Got command RPT from MCS: ref #1184017
2019-01-16 07:56:38 [DEBUG   ] summary = ERROR
2019-01-16 07:56:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184017  13 58499 28598661 A  ERRORERROR'
2019-01-16 07:56:38 [DEBUG   ] Got command RPT from MCS: ref #1184018
2019-01-16 07:56:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:56:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184018  77 58499 28598865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:56:39 [DEBUG   ] Got command RPT from MCS: ref #1184021
2019-01-16 07:56:39 [DEBUG   ] summary = ERROR
2019-01-16 07:56:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184021  13 58499 28599057 A  ERRORERROR'
2019-01-16 07:56:39 [DEBUG   ] Got command RPT from MCS: ref #1184023
2019-01-16 07:56:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 07:56:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184023  77 58499 28599261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 07:56:39 [DEBUG   ] Got command RPT from MCS: ref #1184024
2019-01-16 07:56:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 07:56:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184024  12 58499 28599465 A  ERRORB¡ff'
2019-01-16 07:56:40 [DEBUG   ] Got command BAM from MCS: ref #1184019
2019-01-16 07:56:40 [INFO    ] Finished processing BAM request
2019-01-16 07:56:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:56:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184019   8 58499 28600033 A  ERROR'
2019-01-16 07:56:40 [DEBUG   ] Got command BAM from MCS: ref #1184020
2019-01-16 07:56:40 [INFO    ] Finished processing BAM request
2019-01-16 07:56:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:56:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184020   8 58499 28600037 A  ERROR'
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 07:56:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 07:56:40 [DEBUG   ] spawn_process: at 2019-01-16 07:56:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 07:56:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 07:56:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 07:56:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:56:56 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-16 07:56:56 [WARNING ] (13, 1, 'bot')
2019-01-16 07:56:56 [WARNING ] (13, 1, 'bot')
2019-01-16 07:56:56 [WARNING ] (13, 1, 'bot')
2019-01-16 07:56:56 [WARNING ] (13, 1, 'bot')
2019-01-16 07:56:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:56:56 [DEBUG   ] Finished updating board flags in 1.073 seconds
2019-01-16 07:57:03 [DEBUG   ] Got command BAM from MCS: ref #1184034
2019-01-16 07:57:03 [INFO    ] Finished processing BAM request
2019-01-16 07:57:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:57:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184034   8 58499 28623033 A  ERROR'
2019-01-16 07:57:03 [DEBUG   ] Got command BAM from MCS: ref #1184033
2019-01-16 07:57:03 [INFO    ] Finished processing BAM request
2019-01-16 07:57:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:57:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184033   8 58499 28623037 A  ERROR'
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 07:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 07:57:03 [DEBUG   ] spawn_process: at 2019-01-16 07:57:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 07:57:14 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-16 07:57:26 [DEBUG   ] Got command BAM from MCS: ref #1184035
2019-01-16 07:57:26 [INFO    ] Finished processing BAM request
2019-01-16 07:57:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:57:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184035   8 58499 28646029 A  ERROR'
2019-01-16 07:57:26 [DEBUG   ] Got command BAM from MCS: ref #1184036
2019-01-16 07:57:26 [INFO    ] Finished processing BAM request
2019-01-16 07:57:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:57:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184036   8 58499 28646033 A  ERROR'
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 07:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 07:57:26 [DEBUG   ] spawn_process: at 2019-01-16 07:57:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 07:57:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 07:57:49 [DEBUG   ] Got command BAM from MCS: ref #1184037
2019-01-16 07:57:49 [INFO    ] Finished processing BAM request
2019-01-16 07:57:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:57:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184037   8 58499 28669029 A  ERROR'
2019-01-16 07:57:49 [DEBUG   ] Got command BAM from MCS: ref #1184038
2019-01-16 07:57:49 [INFO    ] Finished processing BAM request
2019-01-16 07:57:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:57:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184038   8 58499 28669033 A  ERROR'
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 07:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 07:57:49 [DEBUG   ] spawn_process: at 2019-01-16 07:57:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 07:57:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 07:57:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-01-16 07:57:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:57:57 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-16 07:57:57 [WARNING ] (13, 1, 'bot')
2019-01-16 07:57:57 [WARNING ] (13, 1, 'bot')
2019-01-16 07:57:57 [WARNING ] (13, 1, 'bot')
2019-01-16 07:57:57 [WARNING ] (13, 1, 'bot')
2019-01-16 07:57:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:57:57 [DEBUG   ] Finished updating board flags in 1.997 seconds
2019-01-16 07:58:12 [DEBUG   ] Got command BAM from MCS: ref #1184039
2019-01-16 07:58:12 [INFO    ] Finished processing BAM request
2019-01-16 07:58:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:58:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184039   8 58499 28692033 A  ERROR'
2019-01-16 07:58:12 [DEBUG   ] Got command BAM from MCS: ref #1184040
2019-01-16 07:58:12 [INFO    ] Finished processing BAM request
2019-01-16 07:58:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:58:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184040   8 58499 28692037 A  ERROR'
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 07:58:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 07:58:12 [DEBUG   ] spawn_process: at 2019-01-16 07:58:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 07:58:14 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-01-16 07:58:34 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2019-01-16 07:58:35 [DEBUG   ] Got command BAM from MCS: ref #1184042
2019-01-16 07:58:35 [INFO    ] Finished processing BAM request
2019-01-16 07:58:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:58:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184042   8 58499 28715033 A  ERROR'
2019-01-16 07:58:35 [DEBUG   ] Got command BAM from MCS: ref #1184041
2019-01-16 07:58:35 [INFO    ] Finished processing BAM request
2019-01-16 07:58:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:58:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184041   8 58499 28715037 A  ERROR'
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 07:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 07:58:35 [DEBUG   ] spawn_process: at 2019-01-16 07:58:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 07:58:55 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-16 07:58:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2019-01-16 07:58:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 07:58:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:58:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2019-01-16 07:58:56 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-16 07:58:56 [WARNING ] (13, 1, 'bot')
2019-01-16 07:58:56 [WARNING ] (13, 1, 'bot')
2019-01-16 07:58:56 [WARNING ] (13, 1, 'bot')
2019-01-16 07:58:56 [WARNING ] (13, 1, 'bot')
2019-01-16 07:58:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:58:56 [DEBUG   ] Finished updating board flags in 1.200 seconds
2019-01-16 07:58:58 [DEBUG   ] Got command BAM from MCS: ref #1184044
2019-01-16 07:58:58 [INFO    ] Finished processing BAM request
2019-01-16 07:58:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:58:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184044   8 58499 28738033 A  ERROR'
2019-01-16 07:58:58 [DEBUG   ] Got command BAM from MCS: ref #1184043
2019-01-16 07:58:58 [INFO    ] Finished processing BAM request
2019-01-16 07:58:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:58:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184043   8 58499 28738037 A  ERROR'
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 07:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 07:58:58 [DEBUG   ] spawn_process: at 2019-01-16 07:58:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 07:59:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 07:59:21 [DEBUG   ] Got command BAM from MCS: ref #1184046
2019-01-16 07:59:21 [INFO    ] Finished processing BAM request
2019-01-16 07:59:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:59:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184046   8 58499 28761033 A  ERROR'
2019-01-16 07:59:21 [DEBUG   ] Got command BAM from MCS: ref #1184045
2019-01-16 07:59:21 [INFO    ] Finished processing BAM request
2019-01-16 07:59:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:59:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184045   8 58499 28761037 A  ERROR'
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 07:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 07:59:21 [DEBUG   ] spawn_process: at 2019-01-16 07:59:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 07:59:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 07:59:44 [DEBUG   ] Got command BAM from MCS: ref #1184047
2019-01-16 07:59:44 [INFO    ] Finished processing BAM request
2019-01-16 07:59:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:59:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184047   8 58499 28784033 A  ERROR'
2019-01-16 07:59:44 [DEBUG   ] Got command BAM from MCS: ref #1184048
2019-01-16 07:59:44 [INFO    ] Finished processing BAM request
2019-01-16 07:59:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 07:59:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184048   8 58499 28784037 A  ERROR'
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 07:59:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 07:59:44 [DEBUG   ] spawn_process: at 2019-01-16 07:59:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 07:59:55 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-01-16 07:59:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 07:59:56 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-16 07:59:56 [WARNING ] (13, 1, 'bot')
2019-01-16 07:59:56 [WARNING ] (13, 1, 'bot')
2019-01-16 07:59:56 [WARNING ] (13, 1, 'bot')
2019-01-16 07:59:56 [WARNING ] (13, 1, 'bot')
2019-01-16 07:59:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 07:59:56 [DEBUG   ] Finished updating board flags in 1.187 seconds
2019-01-16 08:00:07 [DEBUG   ] Got command BAM from MCS: ref #1184054
2019-01-16 08:00:07 [INFO    ] Finished processing BAM request
2019-01-16 08:00:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:00:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184054   8 58499 28807029 A  ERROR'
2019-01-16 08:00:07 [DEBUG   ] Got command BAM from MCS: ref #1184053
2019-01-16 08:00:07 [INFO    ] Finished processing BAM request
2019-01-16 08:00:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:00:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184053   8 58499 28807033 A  ERROR'
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 08:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 08:00:07 [DEBUG   ] spawn_process: at 2019-01-16 08:00:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 08:00:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 08:00:30 [DEBUG   ] Got command BAM from MCS: ref #1184055
2019-01-16 08:00:30 [INFO    ] Finished processing BAM request
2019-01-16 08:00:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:00:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184055   8 58499 28830033 A  ERROR'
2019-01-16 08:00:30 [DEBUG   ] Got command BAM from MCS: ref #1184056
2019-01-16 08:00:30 [INFO    ] Finished processing BAM request
2019-01-16 08:00:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:00:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184056   8 58499 28830037 A  ERROR'
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 08:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 08:00:30 [DEBUG   ] spawn_process: at 2019-01-16 08:00:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 08:00:35 [DEBUG   ] Finished updating ant stats in 0.777 seconds
2019-01-16 08:00:53 [DEBUG   ] Got command BAM from MCS: ref #1184057
2019-01-16 08:00:53 [INFO    ] Finished processing BAM request
2019-01-16 08:00:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:00:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184057   8 58499 28853025 A  ERROR'
2019-01-16 08:00:53 [DEBUG   ] Got command BAM from MCS: ref #1184058
2019-01-16 08:00:53 [INFO    ] Finished processing BAM request
2019-01-16 08:00:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:00:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184058   8 58499 28853029 A  ERROR'
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 08:00:53 [DEBUG   ] spawn_process: at 2019-01-16 08:00:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 08:00:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 08:00:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-16 08:00:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 08:00:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:00:56 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 08:00:56 [WARNING ] (13, 1, 'bot')
2019-01-16 08:00:56 [WARNING ] (13, 1, 'bot')
2019-01-16 08:00:56 [WARNING ] (13, 1, 'bot')
2019-01-16 08:00:56 [WARNING ] (13, 1, 'bot')
2019-01-16 08:00:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:00:56 [DEBUG   ] Finished updating board flags in 1.001 seconds
2019-01-16 08:01:05 [DEBUG   ] Got command RPT from MCS: ref #1184059
2019-01-16 08:01:05 [DEBUG   ] summary = ERROR
2019-01-16 08:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184059  13 58499 28865265 A  ERRORERROR'
2019-01-16 08:01:05 [DEBUG   ] Got command RPT from MCS: ref #1184060
2019-01-16 08:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184060  77 58499 28865266 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:01:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 08:01:16 [DEBUG   ] Got command BAM from MCS: ref #1184076
2019-01-16 08:01:16 [INFO    ] Finished processing BAM request
2019-01-16 08:01:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:01:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184076   8 58499 28876033 A  ERROR'
2019-01-16 08:01:16 [DEBUG   ] Got command BAM from MCS: ref #1184077
2019-01-16 08:01:16 [INFO    ] Finished processing BAM request
2019-01-16 08:01:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:01:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184077   8 58499 28876037 A  ERROR'
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 08:01:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 08:01:16 [DEBUG   ] spawn_process: at 2019-01-16 08:01:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 08:01:35 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-01-16 08:01:38 [DEBUG   ] Got command RPT from MCS: ref #1184080
2019-01-16 08:01:38 [DEBUG   ] summary = ERROR
2019-01-16 08:01:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184080  13 58499 28898741 A  ERRORERROR'
2019-01-16 08:01:38 [DEBUG   ] Got command RPT from MCS: ref #1184081
2019-01-16 08:01:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:01:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184081  77 58499 28898945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:01:39 [DEBUG   ] Got command BAM from MCS: ref #1184078
2019-01-16 08:01:39 [INFO    ] Finished processing BAM request
2019-01-16 08:01:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:01:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184078   8 58499 28899033 A  ERROR'
2019-01-16 08:01:39 [DEBUG   ] Got command BAM from MCS: ref #1184079
2019-01-16 08:01:39 [INFO    ] Finished processing BAM request
2019-01-16 08:01:39 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:01:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184079   8 58499 28899037 A  ERROR'
2019-01-16 08:01:39 [DEBUG   ] Got command RPT from MCS: ref #1184082
2019-01-16 08:01:39 [DEBUG   ] summary = ERROR
2019-01-16 08:01:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184082  13 58499 28899145 A  ERRORERROR'
2019-01-16 08:01:39 [DEBUG   ] Got command RPT from MCS: ref #1184083
2019-01-16 08:01:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:01:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184083  77 58499 28899349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:01:39 [DEBUG   ] Got command RPT from MCS: ref #1184084
2019-01-16 08:01:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 08:01:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184084  12 58499 28899541 A  ERRORB¢ff'
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 08:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 08:01:39 [DEBUG   ] spawn_process: at 2019-01-16 08:01:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 08:01:55 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-16 08:01:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-16 08:01:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:01:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 08:01:56 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 08:01:56 [WARNING ] (13, 1, 'bot')
2019-01-16 08:01:56 [WARNING ] (13, 1, 'bot')
2019-01-16 08:01:56 [WARNING ] (13, 1, 'bot')
2019-01-16 08:01:56 [WARNING ] (13, 1, 'bot')
2019-01-16 08:01:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:01:56 [DEBUG   ] Finished updating board flags in 0.997 seconds
2019-01-16 08:02:02 [DEBUG   ] Got command BAM from MCS: ref #1184086
2019-01-16 08:02:02 [INFO    ] Finished processing BAM request
2019-01-16 08:02:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184086   8 58499 28922025 A  ERROR'
2019-01-16 08:02:02 [DEBUG   ] Got command BAM from MCS: ref #1184085
2019-01-16 08:02:02 [INFO    ] Finished processing BAM request
2019-01-16 08:02:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184085   8 58499 28922029 A  ERROR'
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 08:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 08:02:02 [DEBUG   ] spawn_process: at 2019-01-16 08:02:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 08:02:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 08:02:25 [DEBUG   ] Got command BAM from MCS: ref #1184088
2019-01-16 08:02:25 [INFO    ] Finished processing BAM request
2019-01-16 08:02:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:02:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184088   8 58499 28945029 A  ERROR'
2019-01-16 08:02:25 [DEBUG   ] Got command BAM from MCS: ref #1184087
2019-01-16 08:02:25 [INFO    ] Finished processing BAM request
2019-01-16 08:02:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:02:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184087   8 58499 28945033 A  ERROR'
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 08:02:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 08:02:25 [DEBUG   ] spawn_process: at 2019-01-16 08:02:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 08:02:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 08:02:48 [DEBUG   ] Got command BAM from MCS: ref #1184094
2019-01-16 08:02:48 [INFO    ] Finished processing BAM request
2019-01-16 08:02:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:02:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184094   8 58499 28968029 A  ERROR'
2019-01-16 08:02:48 [DEBUG   ] Got command BAM from MCS: ref #1184093
2019-01-16 08:02:48 [INFO    ] Finished processing BAM request
2019-01-16 08:02:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:02:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184093   8 58499 28968033 A  ERROR'
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 08:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 08:02:48 [DEBUG   ] spawn_process: at 2019-01-16 08:02:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 08:02:56 [DEBUG   ] Finished updating ant stats in 1.231 seconds
2019-01-16 08:02:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-16 08:02:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:02:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 08:02:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 08:02:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-16 08:02:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:02:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:02:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:02:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:02:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:02:57 [DEBUG   ] Finished updating board flags in 1.358 seconds
2019-01-16 08:03:11 [DEBUG   ] Got command BAM from MCS: ref #1184096
2019-01-16 08:03:11 [INFO    ] Finished processing BAM request
2019-01-16 08:03:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:03:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184096   8 58499 28991025 A  ERROR'
2019-01-16 08:03:11 [DEBUG   ] Got command BAM from MCS: ref #1184095
2019-01-16 08:03:11 [INFO    ] Finished processing BAM request
2019-01-16 08:03:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:03:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184095   8 58499 28991029 A  ERROR'
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 08:03:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 08:03:11 [DEBUG   ] spawn_process: at 2019-01-16 08:03:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 08:03:16 [DEBUG   ] Finished updating ant stats in 1.174 seconds
2019-01-16 08:03:34 [DEBUG   ] Got command BAM from MCS: ref #1184098
2019-01-16 08:03:34 [INFO    ] Finished processing BAM request
2019-01-16 08:03:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:03:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184098   8 58499 29014025 A  ERROR'
2019-01-16 08:03:34 [DEBUG   ] Got command BAM from MCS: ref #1184097
2019-01-16 08:03:34 [INFO    ] Finished processing BAM request
2019-01-16 08:03:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:03:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184097   8 58499 29014029 A  ERROR'
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 08:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 08:03:34 [DEBUG   ] spawn_process: at 2019-01-16 08:03:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 08:03:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:03:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:03:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:03:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-16 08:03:57 [DEBUG   ] Got command BAM from MCS: ref #1184100
2019-01-16 08:03:57 [INFO    ] Finished processing BAM request
2019-01-16 08:03:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:03:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184100   8 58499 29037033 A  ERROR'
2019-01-16 08:03:57 [DEBUG   ] Got command BAM from MCS: ref #1184099
2019-01-16 08:03:57 [INFO    ] Finished processing BAM request
2019-01-16 08:03:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:03:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184099   8 58499 29037037 A  ERROR'
2019-01-16 08:03:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 08:03:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 08:03:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:03:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:03:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:03:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:03:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:03:57 [DEBUG   ] Finished updating board flags in 1.190 seconds
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 08:03:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 08:03:57 [DEBUG   ] spawn_process: at 2019-01-16 08:03:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 08:04:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 08:04:20 [DEBUG   ] Got command BAM from MCS: ref #1184101
2019-01-16 08:04:20 [INFO    ] Finished processing BAM request
2019-01-16 08:04:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184101   8 58499 29060029 A  ERROR'
2019-01-16 08:04:20 [DEBUG   ] Got command BAM from MCS: ref #1184102
2019-01-16 08:04:20 [INFO    ] Finished processing BAM request
2019-01-16 08:04:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184102   8 58499 29060033 A  ERROR'
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 08:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 08:04:20 [DEBUG   ] spawn_process: at 2019-01-16 08:04:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 08:04:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 08:04:43 [DEBUG   ] Got command BAM from MCS: ref #1184104
2019-01-16 08:04:43 [INFO    ] Finished processing BAM request
2019-01-16 08:04:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:04:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184104   8 58499 29083033 A  ERROR'
2019-01-16 08:04:43 [DEBUG   ] Got command BAM from MCS: ref #1184103
2019-01-16 08:04:43 [INFO    ] Finished processing BAM request
2019-01-16 08:04:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:04:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184103   8 58499 29083037 A  ERROR'
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 08:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 08:04:43 [DEBUG   ] spawn_process: at 2019-01-16 08:04:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 08:04:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 08:04:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-16 08:04:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:04:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 08:04:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 08:04:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-01-16 08:04:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:04:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:04:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:04:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:04:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:04:57 [DEBUG   ] Finished updating board flags in 1.017 seconds
2019-01-16 08:05:06 [DEBUG   ] Got command BAM from MCS: ref #1184106
2019-01-16 08:05:06 [INFO    ] Finished processing BAM request
2019-01-16 08:05:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:05:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184106   8 58499 29106029 A  ERROR'
2019-01-16 08:05:06 [DEBUG   ] Got command BAM from MCS: ref #1184105
2019-01-16 08:05:06 [INFO    ] Finished processing BAM request
2019-01-16 08:05:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:05:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184105   8 58499 29106033 A  ERROR'
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 08:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 08:05:06 [DEBUG   ] spawn_process: at 2019-01-16 08:05:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 08:05:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:05:29 [DEBUG   ] Got command BAM from MCS: ref #1184108
2019-01-16 08:05:29 [INFO    ] Finished processing BAM request
2019-01-16 08:05:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:05:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184108   8 58499 29129029 A  ERROR'
2019-01-16 08:05:29 [DEBUG   ] Got command BAM from MCS: ref #1184107
2019-01-16 08:05:29 [INFO    ] Finished processing BAM request
2019-01-16 08:05:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:05:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184107   8 58499 29129033 A  ERROR'
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 08:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 08:05:29 [DEBUG   ] spawn_process: at 2019-01-16 08:05:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 08:05:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 08:05:52 [DEBUG   ] Got command BAM from MCS: ref #1184113
2019-01-16 08:05:52 [INFO    ] Finished processing BAM request
2019-01-16 08:05:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:05:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184113   8 58499 29152025 A  ERROR'
2019-01-16 08:05:52 [DEBUG   ] Got command BAM from MCS: ref #1184114
2019-01-16 08:05:52 [INFO    ] Finished processing BAM request
2019-01-16 08:05:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:05:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184114   8 58499 29152029 A  ERROR'
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 08:05:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 08:05:52 [DEBUG   ] spawn_process: at 2019-01-16 08:05:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 08:05:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 08:05:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-16 08:05:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:05:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 08:05:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 08:05:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 08:05:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:05:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:05:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:05:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:05:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:05:57 [DEBUG   ] Finished updating board flags in 0.991 seconds
2019-01-16 08:06:05 [DEBUG   ] Got command RPT from MCS: ref #1184115
2019-01-16 08:06:05 [DEBUG   ] summary = ERROR
2019-01-16 08:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184115  13 58499 29165257 A  ERRORERROR'
2019-01-16 08:06:05 [DEBUG   ] Got command RPT from MCS: ref #1184116
2019-01-16 08:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184116  77 58499 29165258 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:06:15 [DEBUG   ] Got command BAM from MCS: ref #1184132
2019-01-16 08:06:15 [INFO    ] Finished processing BAM request
2019-01-16 08:06:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:06:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184132   8 58499 29175029 A  ERROR'
2019-01-16 08:06:15 [DEBUG   ] Got command BAM from MCS: ref #1184133
2019-01-16 08:06:15 [INFO    ] Finished processing BAM request
2019-01-16 08:06:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:06:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184133   8 58499 29175033 A  ERROR'
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 08:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 08:06:15 [DEBUG   ] spawn_process: at 2019-01-16 08:06:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 08:06:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:06:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:06:38 [DEBUG   ] Got command BAM from MCS: ref #1184137
2019-01-16 08:06:38 [INFO    ] Finished processing BAM request
2019-01-16 08:06:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:06:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184137   8 58499 29198033 A  ERROR'
2019-01-16 08:06:38 [DEBUG   ] Got command BAM from MCS: ref #1184136
2019-01-16 08:06:38 [INFO    ] Finished processing BAM request
2019-01-16 08:06:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:06:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184136   8 58499 29198037 A  ERROR'
2019-01-16 08:06:38 [DEBUG   ] Got command RPT from MCS: ref #1184138
2019-01-16 08:06:38 [DEBUG   ] summary = ERROR
2019-01-16 08:06:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184138  13 58499 29198829 A  ERRORERROR'
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 08:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 08:06:38 [DEBUG   ] spawn_process: at 2019-01-16 08:06:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 08:06:39 [DEBUG   ] Got command RPT from MCS: ref #1184139
2019-01-16 08:06:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:06:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184139  77 58499 29199033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:06:39 [DEBUG   ] Got command RPT from MCS: ref #1184140
2019-01-16 08:06:39 [DEBUG   ] summary = ERROR
2019-01-16 08:06:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184140  13 58499 29199225 A  ERRORERROR'
2019-01-16 08:06:39 [DEBUG   ] Got command RPT from MCS: ref #1184142
2019-01-16 08:06:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:06:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184142  77 58499 29199429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:06:39 [DEBUG   ] Got command RPT from MCS: ref #1184143
2019-01-16 08:06:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 08:06:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184143  12 58499 29199633 A  ERRORB£ff'
2019-01-16 08:06:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:06:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 08:06:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:06:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 08:06:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:06:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:06:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:06:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:06:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:06:57 [DEBUG   ] Finished updating board flags in 1.281 seconds
2019-01-16 08:07:01 [DEBUG   ] Got command BAM from MCS: ref #1184149
2019-01-16 08:07:01 [INFO    ] Finished processing BAM request
2019-01-16 08:07:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184149   8 58499 29221029 A  ERROR'
2019-01-16 08:07:01 [DEBUG   ] Got command BAM from MCS: ref #1184148
2019-01-16 08:07:01 [INFO    ] Finished processing BAM request
2019-01-16 08:07:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184148   8 58499 29221033 A  ERROR'
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 08:07:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 08:07:01 [DEBUG   ] spawn_process: at 2019-01-16 08:07:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 08:07:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:07:24 [DEBUG   ] Got command BAM from MCS: ref #1184150
2019-01-16 08:07:24 [INFO    ] Finished processing BAM request
2019-01-16 08:07:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:07:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184150   8 58499 29244033 A  ERROR'
2019-01-16 08:07:24 [DEBUG   ] Got command BAM from MCS: ref #1184151
2019-01-16 08:07:24 [INFO    ] Finished processing BAM request
2019-01-16 08:07:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:07:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184151   8 58499 29244037 A  ERROR'
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 08:07:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 08:07:24 [DEBUG   ] spawn_process: at 2019-01-16 08:07:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 08:07:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 08:07:47 [DEBUG   ] Got command BAM from MCS: ref #1184153
2019-01-16 08:07:47 [INFO    ] Finished processing BAM request
2019-01-16 08:07:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:07:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184153   8 58499 29267025 A  ERROR'
2019-01-16 08:07:47 [DEBUG   ] Got command BAM from MCS: ref #1184152
2019-01-16 08:07:47 [INFO    ] Finished processing BAM request
2019-01-16 08:07:47 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:07:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184152   8 58499 29267029 A  ERROR'
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 08:07:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 08:07:47 [DEBUG   ] spawn_process: at 2019-01-16 08:07:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 08:07:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 08:07:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-01-16 08:07:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:07:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 08:07:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 08:07:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:07:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:07:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:07:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:07:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:07:57 [DEBUG   ] Finished updating board flags in 1.169 seconds
2019-01-16 08:08:10 [DEBUG   ] Got command BAM from MCS: ref #1184155
2019-01-16 08:08:10 [INFO    ] Finished processing BAM request
2019-01-16 08:08:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:08:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184155   8 58499 29290029 A  ERROR'
2019-01-16 08:08:10 [DEBUG   ] Got command BAM from MCS: ref #1184154
2019-01-16 08:08:10 [INFO    ] Finished processing BAM request
2019-01-16 08:08:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:08:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184154   8 58499 29290033 A  ERROR'
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 08:08:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 08:08:10 [DEBUG   ] spawn_process: at 2019-01-16 08:08:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 08:08:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 08:08:33 [DEBUG   ] Got command BAM from MCS: ref #1184156
2019-01-16 08:08:33 [INFO    ] Finished processing BAM request
2019-01-16 08:08:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:08:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184156   8 58499 29313033 A  ERROR'
2019-01-16 08:08:33 [DEBUG   ] Got command BAM from MCS: ref #1184157
2019-01-16 08:08:33 [INFO    ] Finished processing BAM request
2019-01-16 08:08:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:08:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184157   8 58499 29313037 A  ERROR'
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 08:08:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 08:08:33 [DEBUG   ] spawn_process: at 2019-01-16 08:08:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 08:08:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 08:08:56 [DEBUG   ] Got command BAM from MCS: ref #1184162
2019-01-16 08:08:56 [INFO    ] Finished processing BAM request
2019-01-16 08:08:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:08:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184162   8 58499 29336025 A  ERROR'
2019-01-16 08:08:56 [DEBUG   ] Got command BAM from MCS: ref #1184163
2019-01-16 08:08:56 [INFO    ] Finished processing BAM request
2019-01-16 08:08:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:08:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184163   8 58499 29336029 A  ERROR'
2019-01-16 08:08:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 08:08:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 08:08:56 [DEBUG   ] spawn_process: at 2019-01-16 08:08:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 08:08:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-16 08:08:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:08:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 08:08:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 08:08:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:08:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:08:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:08:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:08:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:08:57 [DEBUG   ] Finished updating board flags in 1.013 seconds
2019-01-16 08:09:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:09:19 [DEBUG   ] Got command BAM from MCS: ref #1184164
2019-01-16 08:09:19 [INFO    ] Finished processing BAM request
2019-01-16 08:09:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:09:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184164   8 58499 29359025 A  ERROR'
2019-01-16 08:09:19 [DEBUG   ] Got command BAM from MCS: ref #1184165
2019-01-16 08:09:19 [INFO    ] Finished processing BAM request
2019-01-16 08:09:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:09:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184165   8 58499 29359029 A  ERROR'
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 08:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 08:09:19 [DEBUG   ] spawn_process: at 2019-01-16 08:09:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 08:09:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 08:09:42 [DEBUG   ] Got command BAM from MCS: ref #1184166
2019-01-16 08:09:42 [INFO    ] Finished processing BAM request
2019-01-16 08:09:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:09:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184166   8 58499 29382029 A  ERROR'
2019-01-16 08:09:42 [DEBUG   ] Got command BAM from MCS: ref #1184167
2019-01-16 08:09:42 [INFO    ] Finished processing BAM request
2019-01-16 08:09:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:09:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184167   8 58499 29382033 A  ERROR'
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 08:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 08:09:42 [DEBUG   ] spawn_process: at 2019-01-16 08:09:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 08:09:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:09:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 08:09:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:09:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 08:09:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 08:09:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:09:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:09:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:09:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:09:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:09:58 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-16 08:10:05 [DEBUG   ] Got command BAM from MCS: ref #1184168
2019-01-16 08:10:05 [INFO    ] Finished processing BAM request
2019-01-16 08:10:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:10:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184168   8 58499 29405033 A  ERROR'
2019-01-16 08:10:05 [DEBUG   ] Got command BAM from MCS: ref #1184169
2019-01-16 08:10:05 [INFO    ] Finished processing BAM request
2019-01-16 08:10:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:10:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184169   8 58499 29405037 A  ERROR'
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 08:10:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 08:10:05 [DEBUG   ] spawn_process: at 2019-01-16 08:10:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 08:10:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:10:28 [DEBUG   ] Got command BAM from MCS: ref #1184171
2019-01-16 08:10:28 [INFO    ] Finished processing BAM request
2019-01-16 08:10:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:10:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184171   8 58499 29428025 A  ERROR'
2019-01-16 08:10:28 [DEBUG   ] Got command BAM from MCS: ref #1184170
2019-01-16 08:10:28 [INFO    ] Finished processing BAM request
2019-01-16 08:10:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:10:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184170   8 58499 29428029 A  ERROR'
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 08:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 08:10:28 [DEBUG   ] spawn_process: at 2019-01-16 08:10:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 08:10:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:10:51 [DEBUG   ] Got command BAM from MCS: ref #1184172
2019-01-16 08:10:51 [INFO    ] Finished processing BAM request
2019-01-16 08:10:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:10:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184172   8 58499 29451025 A  ERROR'
2019-01-16 08:10:51 [DEBUG   ] Got command BAM from MCS: ref #1184173
2019-01-16 08:10:51 [INFO    ] Finished processing BAM request
2019-01-16 08:10:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:10:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184173   8 58499 29451029 A  ERROR'
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 08:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 08:10:51 [DEBUG   ] spawn_process: at 2019-01-16 08:10:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 08:10:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:10:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:10:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 08:10:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 08:10:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 08:10:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-16 08:10:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 08:10:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:10:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:10:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:10:57 [WARNING ] (13, 1, 'bot')
2019-01-16 08:10:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:10:57 [DEBUG   ] Finished updating board flags in 0.975 seconds
2019-01-16 08:11:05 [DEBUG   ] Got command RPT from MCS: ref #1184174
2019-01-16 08:11:05 [DEBUG   ] summary = ERROR
2019-01-16 08:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184174  13 58499 29465265 A  ERRORERROR'
2019-01-16 08:11:05 [DEBUG   ] Got command RPT from MCS: ref #1184175
2019-01-16 08:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184175  77 58499 29465266 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:11:14 [DEBUG   ] Got command BAM from MCS: ref #1184191
2019-01-16 08:11:14 [INFO    ] Finished processing BAM request
2019-01-16 08:11:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:11:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184191   8 58499 29474029 A  ERROR'
2019-01-16 08:11:14 [DEBUG   ] Got command BAM from MCS: ref #1184192
2019-01-16 08:11:14 [INFO    ] Finished processing BAM request
2019-01-16 08:11:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:11:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184192   8 58499 29474033 A  ERROR'
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 08:11:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 08:11:14 [DEBUG   ] spawn_process: at 2019-01-16 08:11:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 08:11:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 08:11:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:11:37 [DEBUG   ] Got command BAM from MCS: ref #1184194
2019-01-16 08:11:37 [INFO    ] Finished processing BAM request
2019-01-16 08:11:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:11:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184194   8 58499 29497029 A  ERROR'
2019-01-16 08:11:37 [DEBUG   ] Got command BAM from MCS: ref #1184193
2019-01-16 08:11:37 [INFO    ] Finished processing BAM request
2019-01-16 08:11:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:11:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184193   8 58499 29497033 A  ERROR'
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 08:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 08:11:37 [DEBUG   ] spawn_process: at 2019-01-16 08:11:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 08:11:38 [DEBUG   ] Got command RPT from MCS: ref #1184195
2019-01-16 08:11:38 [DEBUG   ] summary = ERROR
2019-01-16 08:11:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184195  13 58499 29498917 A  ERRORERROR'
2019-01-16 08:11:39 [DEBUG   ] Got command RPT from MCS: ref #1184196
2019-01-16 08:11:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:11:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184196  77 58499 29499109 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:11:39 [DEBUG   ] Got command RPT from MCS: ref #1184197
2019-01-16 08:11:39 [DEBUG   ] summary = ERROR
2019-01-16 08:11:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184197  13 58499 29499313 A  ERRORERROR'
2019-01-16 08:11:39 [DEBUG   ] Got command RPT from MCS: ref #1184198
2019-01-16 08:11:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:11:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184198  77 58499 29499517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:11:39 [DEBUG   ] Got command RPT from MCS: ref #1184199
2019-01-16 08:11:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 08:11:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184199  12 58499 29499721 A  ERRORB¢ff'
2019-01-16 08:11:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:11:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 08:11:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:11:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 08:11:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:11:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:11:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:11:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:11:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:11:58 [DEBUG   ] Finished updating board flags in 1.360 seconds
2019-01-16 08:12:00 [DEBUG   ] Got command BAM from MCS: ref #1184204
2019-01-16 08:12:00 [INFO    ] Finished processing BAM request
2019-01-16 08:12:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:12:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184204   8 58499 29520029 A  ERROR'
2019-01-16 08:12:00 [DEBUG   ] Got command BAM from MCS: ref #1184205
2019-01-16 08:12:00 [INFO    ] Finished processing BAM request
2019-01-16 08:12:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:12:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184205   8 58499 29520033 A  ERROR'
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 08:12:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 08:12:00 [DEBUG   ] spawn_process: at 2019-01-16 08:12:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 08:12:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 08:12:23 [DEBUG   ] Got command BAM from MCS: ref #1184207
2019-01-16 08:12:23 [INFO    ] Finished processing BAM request
2019-01-16 08:12:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:12:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184207   8 58499 29543033 A  ERROR'
2019-01-16 08:12:23 [DEBUG   ] Got command BAM from MCS: ref #1184206
2019-01-16 08:12:23 [INFO    ] Finished processing BAM request
2019-01-16 08:12:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:12:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184206   8 58499 29543037 A  ERROR'
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 08:12:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 08:12:23 [DEBUG   ] spawn_process: at 2019-01-16 08:12:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 08:12:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:12:46 [DEBUG   ] Got command BAM from MCS: ref #1184209
2019-01-16 08:12:46 [INFO    ] Finished processing BAM request
2019-01-16 08:12:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:12:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184209   8 58499 29566073 A  ERROR'
2019-01-16 08:12:46 [DEBUG   ] Got command BAM from MCS: ref #1184208
2019-01-16 08:12:46 [INFO    ] Finished processing BAM request
2019-01-16 08:12:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:12:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184208   8 58499 29566077 A  ERROR'
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 08:12:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 08:12:46 [DEBUG   ] spawn_process: at 2019-01-16 08:12:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 08:12:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:12:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-16 08:12:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-16 08:12:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:12:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 08:12:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:12:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:12:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:12:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:12:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:12:58 [DEBUG   ] Finished updating board flags in 1.206 seconds
2019-01-16 08:13:09 [DEBUG   ] Got command BAM from MCS: ref #1184210
2019-01-16 08:13:09 [INFO    ] Finished processing BAM request
2019-01-16 08:13:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:13:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184210   8 58499 29589049 A  ERROR'
2019-01-16 08:13:09 [DEBUG   ] Got command BAM from MCS: ref #1184211
2019-01-16 08:13:09 [INFO    ] Finished processing BAM request
2019-01-16 08:13:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:13:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184211   8 58499 29589057 A  ERROR'
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 08:13:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 08:13:09 [DEBUG   ] spawn_process: at 2019-01-16 08:13:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 08:13:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:13:32 [DEBUG   ] Got command BAM from MCS: ref #1184212
2019-01-16 08:13:32 [INFO    ] Finished processing BAM request
2019-01-16 08:13:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184212   8 58499 29612033 A  ERROR'
2019-01-16 08:13:32 [DEBUG   ] Got command BAM from MCS: ref #1184213
2019-01-16 08:13:32 [INFO    ] Finished processing BAM request
2019-01-16 08:13:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184213   8 58499 29612037 A  ERROR'
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 08:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 08:13:32 [DEBUG   ] spawn_process: at 2019-01-16 08:13:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 08:13:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:13:55 [DEBUG   ] Got command BAM from MCS: ref #1184215
2019-01-16 08:13:55 [INFO    ] Finished processing BAM request
2019-01-16 08:13:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:13:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184215   8 58499 29635025 A  ERROR'
2019-01-16 08:13:55 [DEBUG   ] Got command BAM from MCS: ref #1184214
2019-01-16 08:13:55 [INFO    ] Finished processing BAM request
2019-01-16 08:13:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:13:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184214   8 58499 29635029 A  ERROR'
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 08:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 08:13:55 [DEBUG   ] spawn_process: at 2019-01-16 08:13:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 08:13:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:13:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 08:13:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:13:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 08:13:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 08:13:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:13:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:13:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:13:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:13:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:13:58 [DEBUG   ] Finished updating board flags in 1.207 seconds
2019-01-16 08:14:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:14:18 [DEBUG   ] Got command BAM from MCS: ref #1184217
2019-01-16 08:14:18 [INFO    ] Finished processing BAM request
2019-01-16 08:14:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:14:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184217   8 58499 29658033 A  ERROR'
2019-01-16 08:14:18 [DEBUG   ] Got command BAM from MCS: ref #1184216
2019-01-16 08:14:18 [INFO    ] Finished processing BAM request
2019-01-16 08:14:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:14:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184216   8 58499 29658037 A  ERROR'
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 08:14:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 08:14:18 [DEBUG   ] spawn_process: at 2019-01-16 08:14:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 08:14:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:14:41 [DEBUG   ] Got command BAM from MCS: ref #1184218
2019-01-16 08:14:41 [INFO    ] Finished processing BAM request
2019-01-16 08:14:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:14:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184218   8 58499 29681025 A  ERROR'
2019-01-16 08:14:41 [DEBUG   ] Got command BAM from MCS: ref #1184219
2019-01-16 08:14:41 [INFO    ] Finished processing BAM request
2019-01-16 08:14:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:14:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184219   8 58499 29681029 A  ERROR'
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 08:14:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 08:14:41 [DEBUG   ] spawn_process: at 2019-01-16 08:14:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 08:14:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:14:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:14:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 08:14:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2019-01-16 08:14:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:14:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:14:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:14:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:14:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:14:58 [DEBUG   ] Finished updating board flags in 1.202 seconds
2019-01-16 08:15:04 [DEBUG   ] Got command BAM from MCS: ref #1184225
2019-01-16 08:15:04 [INFO    ] Finished processing BAM request
2019-01-16 08:15:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:15:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184225   8 58499 29704029 A  ERROR'
2019-01-16 08:15:04 [DEBUG   ] Got command BAM from MCS: ref #1184224
2019-01-16 08:15:04 [INFO    ] Finished processing BAM request
2019-01-16 08:15:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:15:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184224   8 58499 29704033 A  ERROR'
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 08:15:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 08:15:04 [DEBUG   ] spawn_process: at 2019-01-16 08:15:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 08:15:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 08:15:27 [DEBUG   ] Got command BAM from MCS: ref #1184226
2019-01-16 08:15:27 [INFO    ] Finished processing BAM request
2019-01-16 08:15:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:15:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184226   8 58499 29727033 A  ERROR'
2019-01-16 08:15:27 [DEBUG   ] Got command BAM from MCS: ref #1184227
2019-01-16 08:15:27 [INFO    ] Finished processing BAM request
2019-01-16 08:15:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:15:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184227   8 58499 29727037 A  ERROR'
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 08:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 08:15:27 [DEBUG   ] spawn_process: at 2019-01-16 08:15:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 08:15:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:15:50 [DEBUG   ] Got command BAM from MCS: ref #1184228
2019-01-16 08:15:50 [INFO    ] Finished processing BAM request
2019-01-16 08:15:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:15:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184228   8 58499 29750025 A  ERROR'
2019-01-16 08:15:50 [DEBUG   ] Got command BAM from MCS: ref #1184229
2019-01-16 08:15:50 [INFO    ] Finished processing BAM request
2019-01-16 08:15:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:15:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184229   8 58499 29750029 A  ERROR'
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 08:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 08:15:50 [DEBUG   ] spawn_process: at 2019-01-16 08:15:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 08:15:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 08:15:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 08:15:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:15:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-01-16 08:15:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 08:15:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:15:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:15:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:15:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:15:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:15:58 [DEBUG   ] Finished updating board flags in 1.201 seconds
2019-01-16 08:16:05 [DEBUG   ] Got command RPT from MCS: ref #1184230
2019-01-16 08:16:05 [DEBUG   ] summary = ERROR
2019-01-16 08:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184230  13 58499 29765261 A  ERRORERROR'
2019-01-16 08:16:05 [DEBUG   ] Got command RPT from MCS: ref #1184231
2019-01-16 08:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184231  77 58499 29765262 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:16:13 [DEBUG   ] Got command BAM from MCS: ref #1184248
2019-01-16 08:16:13 [INFO    ] Finished processing BAM request
2019-01-16 08:16:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:16:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184248   8 58499 29773029 A  ERROR'
2019-01-16 08:16:13 [DEBUG   ] Got command BAM from MCS: ref #1184247
2019-01-16 08:16:13 [INFO    ] Finished processing BAM request
2019-01-16 08:16:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:16:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184247   8 58499 29773033 A  ERROR'
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 08:16:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 08:16:13 [DEBUG   ] spawn_process: at 2019-01-16 08:16:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 08:16:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:16:36 [DEBUG   ] Got command BAM from MCS: ref #1184251
2019-01-16 08:16:36 [INFO    ] Finished processing BAM request
2019-01-16 08:16:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:16:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184251   8 58499 29796025 A  ERROR'
2019-01-16 08:16:36 [DEBUG   ] Got command BAM from MCS: ref #1184252
2019-01-16 08:16:36 [INFO    ] Finished processing BAM request
2019-01-16 08:16:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:16:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184252   8 58499 29796029 A  ERROR'
2019-01-16 08:16:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 08:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 08:16:36 [DEBUG   ] spawn_process: at 2019-01-16 08:16:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 08:16:39 [DEBUG   ] Got command RPT from MCS: ref #1184253
2019-01-16 08:16:39 [DEBUG   ] summary = ERROR
2019-01-16 08:16:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184253  13 58499 29799001 A  ERRORERROR'
2019-01-16 08:16:39 [DEBUG   ] Got command RPT from MCS: ref #1184254
2019-01-16 08:16:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:16:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184254  77 58499 29799205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:16:39 [DEBUG   ] Got command RPT from MCS: ref #1184255
2019-01-16 08:16:39 [DEBUG   ] summary = ERROR
2019-01-16 08:16:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184255  13 58499 29799397 A  ERRORERROR'
2019-01-16 08:16:39 [DEBUG   ] Got command RPT from MCS: ref #1184257
2019-01-16 08:16:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:16:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184257  77 58499 29799601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:16:39 [DEBUG   ] Got command RPT from MCS: ref #1184259
2019-01-16 08:16:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 08:16:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184259  12 58499 29799805 A  ERRORB¢ff'
2019-01-16 08:16:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 08:16:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:16:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 08:16:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 08:16:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:16:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:16:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:16:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:16:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:16:58 [DEBUG   ] Finished updating board flags in 1.209 seconds
2019-01-16 08:16:59 [DEBUG   ] Got command BAM from MCS: ref #1184264
2019-01-16 08:16:59 [INFO    ] Finished processing BAM request
2019-01-16 08:16:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:16:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184264   8 58499 29819029 A  ERROR'
2019-01-16 08:16:59 [DEBUG   ] Got command BAM from MCS: ref #1184263
2019-01-16 08:16:59 [INFO    ] Finished processing BAM request
2019-01-16 08:16:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:16:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184263   8 58499 29819033 A  ERROR'
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 08:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 08:16:59 [DEBUG   ] spawn_process: at 2019-01-16 08:16:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 08:17:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:17:22 [DEBUG   ] Got command BAM from MCS: ref #1184265
2019-01-16 08:17:22 [INFO    ] Finished processing BAM request
2019-01-16 08:17:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:17:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184265   8 58499 29842025 A  ERROR'
2019-01-16 08:17:22 [DEBUG   ] Got command BAM from MCS: ref #1184266
2019-01-16 08:17:22 [INFO    ] Finished processing BAM request
2019-01-16 08:17:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:17:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184266   8 58499 29842029 A  ERROR'
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 08:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 08:17:22 [DEBUG   ] spawn_process: at 2019-01-16 08:17:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 08:17:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:17:45 [DEBUG   ] Got command BAM from MCS: ref #1184268
2019-01-16 08:17:45 [INFO    ] Finished processing BAM request
2019-01-16 08:17:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:17:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184268   8 58499 29865033 A  ERROR'
2019-01-16 08:17:45 [DEBUG   ] Got command BAM from MCS: ref #1184267
2019-01-16 08:17:45 [INFO    ] Finished processing BAM request
2019-01-16 08:17:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:17:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184267   8 58499 29865037 A  ERROR'
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 08:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 08:17:45 [DEBUG   ] spawn_process: at 2019-01-16 08:17:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 08:17:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:17:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-16 08:17:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-16 08:17:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 08:17:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:17:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 08:17:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 08:17:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 08:17:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:17:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:17:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:17:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:17:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:17:58 [DEBUG   ] Finished updating board flags in 1.255 seconds
2019-01-16 08:18:08 [DEBUG   ] Got command BAM from MCS: ref #1184274
2019-01-16 08:18:08 [INFO    ] Finished processing BAM request
2019-01-16 08:18:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:18:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184274   8 58499 29888029 A  ERROR'
2019-01-16 08:18:08 [DEBUG   ] Got command BAM from MCS: ref #1184273
2019-01-16 08:18:08 [INFO    ] Finished processing BAM request
2019-01-16 08:18:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:18:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184273   8 58499 29888033 A  ERROR'
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 08:18:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 08:18:08 [DEBUG   ] spawn_process: at 2019-01-16 08:18:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 08:18:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:18:31 [DEBUG   ] Got command BAM from MCS: ref #1184276
2019-01-16 08:18:31 [INFO    ] Finished processing BAM request
2019-01-16 08:18:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184276   8 58499 29911025 A  ERROR'
2019-01-16 08:18:31 [DEBUG   ] Got command BAM from MCS: ref #1184275
2019-01-16 08:18:31 [INFO    ] Finished processing BAM request
2019-01-16 08:18:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184275   8 58499 29911029 A  ERROR'
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 08:18:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 08:18:31 [DEBUG   ] spawn_process: at 2019-01-16 08:18:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 08:18:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:18:54 [DEBUG   ] Got command BAM from MCS: ref #1184278
2019-01-16 08:18:54 [INFO    ] Finished processing BAM request
2019-01-16 08:18:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:18:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184278   8 58499 29934025 A  ERROR'
2019-01-16 08:18:54 [DEBUG   ] Got command BAM from MCS: ref #1184277
2019-01-16 08:18:54 [INFO    ] Finished processing BAM request
2019-01-16 08:18:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:18:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184277   8 58499 29934029 A  ERROR'
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 08:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 08:18:54 [DEBUG   ] spawn_process: at 2019-01-16 08:18:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 08:18:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 08:18:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-16 08:18:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 08:18:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 08:18:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:18:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 08:18:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 08:18:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 08:18:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:18:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:18:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:18:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:18:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:18:58 [DEBUG   ] Finished updating board flags in 1.128 seconds
2019-01-16 08:19:16 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-16 08:19:17 [DEBUG   ] Got command BAM from MCS: ref #1184280
2019-01-16 08:19:17 [INFO    ] Finished processing BAM request
2019-01-16 08:19:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:19:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184280   8 58499 29957033 A  ERROR'
2019-01-16 08:19:17 [DEBUG   ] Got command BAM from MCS: ref #1184279
2019-01-16 08:19:17 [INFO    ] Finished processing BAM request
2019-01-16 08:19:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:19:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184279   8 58499 29957037 A  ERROR'
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 08:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 08:19:17 [DEBUG   ] spawn_process: at 2019-01-16 08:19:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 08:19:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 08:19:40 [DEBUG   ] Got command BAM from MCS: ref #1184282
2019-01-16 08:19:40 [INFO    ] Finished processing BAM request
2019-01-16 08:19:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:19:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184282   8 58499 29980029 A  ERROR'
2019-01-16 08:19:40 [DEBUG   ] Got command BAM from MCS: ref #1184281
2019-01-16 08:19:40 [INFO    ] Finished processing BAM request
2019-01-16 08:19:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:19:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184281   8 58499 29980033 A  ERROR'
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 08:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 08:19:40 [DEBUG   ] spawn_process: at 2019-01-16 08:19:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 08:19:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 08:19:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:19:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 08:19:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 08:19:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:19:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:19:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:19:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:19:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:19:58 [DEBUG   ] Finished updating board flags in 1.005 seconds
2019-01-16 08:20:03 [DEBUG   ] Got command BAM from MCS: ref #1184284
2019-01-16 08:20:03 [INFO    ] Finished processing BAM request
2019-01-16 08:20:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184284   8 58499 30003033 A  ERROR'
2019-01-16 08:20:03 [DEBUG   ] Got command BAM from MCS: ref #1184283
2019-01-16 08:20:03 [INFO    ] Finished processing BAM request
2019-01-16 08:20:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184283   8 58499 30003037 A  ERROR'
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 08:20:03 [DEBUG   ] spawn_process: at 2019-01-16 08:20:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 08:20:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 08:20:26 [DEBUG   ] Got command BAM from MCS: ref #1184286
2019-01-16 08:20:26 [INFO    ] Finished processing BAM request
2019-01-16 08:20:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:20:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184286   8 58499 30026029 A  ERROR'
2019-01-16 08:20:26 [DEBUG   ] Got command BAM from MCS: ref #1184285
2019-01-16 08:20:26 [INFO    ] Finished processing BAM request
2019-01-16 08:20:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:20:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184285   8 58499 30026033 A  ERROR'
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 08:20:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 08:20:26 [DEBUG   ] spawn_process: at 2019-01-16 08:20:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 08:20:37 [DEBUG   ] Finished updating ant stats in 1.802 seconds
2019-01-16 08:20:49 [DEBUG   ] Got command BAM from MCS: ref #1184291
2019-01-16 08:20:49 [INFO    ] Finished processing BAM request
2019-01-16 08:20:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184291   8 58499 30049029 A  ERROR'
2019-01-16 08:20:49 [DEBUG   ] Got command BAM from MCS: ref #1184292
2019-01-16 08:20:49 [INFO    ] Finished processing BAM request
2019-01-16 08:20:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184292   8 58499 30049033 A  ERROR'
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 08:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 08:20:49 [DEBUG   ] spawn_process: at 2019-01-16 08:20:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 08:20:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 08:20:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 08:20:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 08:20:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:20:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 08:20:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 08:20:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:20:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:20:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:20:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:20:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:20:58 [DEBUG   ] Finished updating board flags in 1.005 seconds
2019-01-16 08:21:05 [DEBUG   ] Got command RPT from MCS: ref #1184293
2019-01-16 08:21:05 [DEBUG   ] summary = ERROR
2019-01-16 08:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184293  13 58499 30065265 A  ERRORERROR'
2019-01-16 08:21:05 [DEBUG   ] Got command RPT from MCS: ref #1184294
2019-01-16 08:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184294  77 58499 30065266 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:21:12 [DEBUG   ] Got command BAM from MCS: ref #1184311
2019-01-16 08:21:12 [INFO    ] Finished processing BAM request
2019-01-16 08:21:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184311   8 58499 30072025 A  ERROR'
2019-01-16 08:21:12 [DEBUG   ] Got command BAM from MCS: ref #1184310
2019-01-16 08:21:12 [INFO    ] Finished processing BAM request
2019-01-16 08:21:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184310   8 58499 30072029 A  ERROR'
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 08:21:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 08:21:12 [DEBUG   ] spawn_process: at 2019-01-16 08:21:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 08:21:17 [DEBUG   ] Finished updating ant stats in 1.802 seconds
2019-01-16 08:21:35 [DEBUG   ] Got command BAM from MCS: ref #1184312
2019-01-16 08:21:35 [INFO    ] Finished processing BAM request
2019-01-16 08:21:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:21:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184312   8 58499 30095033 A  ERROR'
2019-01-16 08:21:35 [DEBUG   ] Got command BAM from MCS: ref #1184313
2019-01-16 08:21:35 [INFO    ] Finished processing BAM request
2019-01-16 08:21:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 08:21:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184313   8 58499 30095037 A  ERROR'
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 08:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 08:21:35 [DEBUG   ] spawn_process: at 2019-01-16 08:21:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 08:21:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 08:21:39 [DEBUG   ] Got command RPT from MCS: ref #1184314
2019-01-16 08:21:39 [DEBUG   ] summary = ERROR
2019-01-16 08:21:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184314  13 58499 30099089 A  ERRORERROR'
2019-01-16 08:21:39 [DEBUG   ] Got command RPT from MCS: ref #1184315
2019-01-16 08:21:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:21:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184315  77 58499 30099281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:21:39 [DEBUG   ] Got command RPT from MCS: ref #1184316
2019-01-16 08:21:39 [DEBUG   ] summary = ERROR
2019-01-16 08:21:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184316  13 58499 30099485 A  ERRORERROR'
2019-01-16 08:21:39 [DEBUG   ] Got command RPT from MCS: ref #1184317
2019-01-16 08:21:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:21:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184317  77 58499 30099689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:21:39 [DEBUG   ] Got command RPT from MCS: ref #1184318
2019-01-16 08:21:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 08:21:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184318  12 58499 30099893 A  ERRORB£ff'
2019-01-16 08:21:43 [DEBUG   ] Got command STP from MCS: ref #1184319
2019-01-16 08:21:43 [INFO    ] Finished processing BAM request
2019-01-16 08:21:43 [INFO    ] Shutdown the adder chain on beam #3
2019-01-16 08:21:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP  1184319   8 58499 30103029 A  ERROR'
2019-01-16 08:21:43 [DEBUG   ] Got command STP from MCS: ref #1184320
2019-01-16 08:21:43 [INFO    ] Finished processing BAM request
2019-01-16 08:21:43 [INFO    ] Shutdown the adder chain on beam #4
2019-01-16 08:21:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP  1184320   8 58499 30103037 A  ERROR'
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 08:21:43 [DEBUG   ] spawn_process: at 2019-01-16 08:21:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 08:21:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 08:21:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:21:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-16 08:21:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:21:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:21:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:21:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:21:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:21:58 [DEBUG   ] Finished updating board flags in 1.001 seconds
2019-01-16 08:22:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 08:22:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 08:22:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 08:22:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:22:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 08:22:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:22:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:22:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:22:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:22:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:22:58 [DEBUG   ] Finished updating board flags in 1.021 seconds
2019-01-16 08:23:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 08:23:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 08:23:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 08:23:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:23:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 08:23:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:23:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:23:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:23:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:23:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:23:58 [DEBUG   ] Finished updating board flags in 0.979 seconds
2019-01-16 08:24:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 08:24:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 08:24:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 08:24:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:24:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 08:24:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:24:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:24:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:24:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:24:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:24:59 [DEBUG   ] Finished updating board flags in 1.880 seconds
2019-01-16 08:25:16 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2019-01-16 08:25:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:25:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:25:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:25:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:25:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:25:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:25:58 [WARNING ] (13, 1, 'bot')
2019-01-16 08:25:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:25:58 [DEBUG   ] Finished updating board flags in 1.170 seconds
2019-01-16 08:26:05 [DEBUG   ] Got command RPT from MCS: ref #1184325
2019-01-16 08:26:05 [DEBUG   ] summary = ERROR
2019-01-16 08:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184325  13 58499 30365261 A  ERRORERROR'
2019-01-16 08:26:05 [DEBUG   ] Got command RPT from MCS: ref #1184326
2019-01-16 08:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184326  77 58499 30365262 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:26:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:26:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:26:39 [DEBUG   ] Got command RPT from MCS: ref #1184344
2019-01-16 08:26:39 [DEBUG   ] summary = ERROR
2019-01-16 08:26:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184344  13 58499 30399165 A  ERRORERROR'
2019-01-16 08:26:39 [DEBUG   ] Got command RPT from MCS: ref #1184345
2019-01-16 08:26:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:26:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184345  77 58499 30399369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:26:39 [DEBUG   ] Got command RPT from MCS: ref #1184346
2019-01-16 08:26:39 [DEBUG   ] summary = ERROR
2019-01-16 08:26:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184346  13 58499 30399573 A  ERRORERROR'
2019-01-16 08:26:39 [DEBUG   ] Got command RPT from MCS: ref #1184348
2019-01-16 08:26:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:26:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184348  77 58499 30399777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:26:39 [DEBUG   ] Got command RPT from MCS: ref #1184349
2019-01-16 08:26:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 08:26:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184349  12 58499 30399969 A  ERRORB™™š'
2019-01-16 08:26:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:26:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:26:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:26:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:26:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:26:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:26:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:26:59 [DEBUG   ] Finished updating board flags in 1.573 seconds
2019-01-16 08:27:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:27:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:27:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 08:27:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:27:59 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 08:27:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 08:27:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:27:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:27:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:27:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:27:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:27:59 [DEBUG   ] Finished updating board flags in 1.383 seconds
2019-01-16 08:28:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 08:28:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:28:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:28:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 08:28:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:28:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:28:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:28:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:28:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:28:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:28:59 [DEBUG   ] Finished updating board flags in 1.219 seconds
2019-01-16 08:29:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:29:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:29:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:29:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:29:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:29:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:29:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:29:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:29:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:29:59 [DEBUG   ] Finished updating board flags in 1.266 seconds
2019-01-16 08:30:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:30:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 08:30:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:30:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:30:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:30:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:30:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:30:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:30:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:30:59 [DEBUG   ] Finished updating board flags in 1.211 seconds
2019-01-16 08:31:05 [DEBUG   ] Got command RPT from MCS: ref #1184362
2019-01-16 08:31:05 [DEBUG   ] summary = ERROR
2019-01-16 08:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184362  13 58499 30665273 A  ERRORERROR'
2019-01-16 08:31:05 [DEBUG   ] Got command RPT from MCS: ref #1184363
2019-01-16 08:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184363  77 58499 30665274 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:31:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:31:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:31:39 [DEBUG   ] Got command RPT from MCS: ref #1184379
2019-01-16 08:31:39 [DEBUG   ] summary = ERROR
2019-01-16 08:31:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184379  13 58499 30699257 A  ERRORERROR'
2019-01-16 08:31:39 [DEBUG   ] Got command RPT from MCS: ref #1184380
2019-01-16 08:31:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:31:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184380  77 58499 30699461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:31:39 [DEBUG   ] Got command RPT from MCS: ref #1184381
2019-01-16 08:31:39 [DEBUG   ] summary = ERROR
2019-01-16 08:31:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184381  13 58499 30699653 A  ERRORERROR'
2019-01-16 08:31:39 [DEBUG   ] Got command RPT from MCS: ref #1184382
2019-01-16 08:31:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:31:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184382  77 58499 30699857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:31:40 [DEBUG   ] Got command RPT from MCS: ref #1184383
2019-01-16 08:31:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 08:31:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184383  12 58499 30700061 A  ERRORB™™š'
2019-01-16 08:31:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:31:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:31:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 08:31:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:31:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:31:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:31:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:31:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:31:59 [DEBUG   ] Finished updating board flags in 1.112 seconds
2019-01-16 08:32:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:32:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 08:32:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:32:58 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 08:32:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:32:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:32:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:32:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:32:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:32:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:32:59 [DEBUG   ] Finished updating board flags in 1.025 seconds
2019-01-16 08:33:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 08:33:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:33:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:33:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 08:33:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:33:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:33:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:33:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:33:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:33:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:33:59 [DEBUG   ] Finished updating board flags in 1.016 seconds
2019-01-16 08:34:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:34:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:34:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:34:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:35:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:35:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:35:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:35:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:35:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:35:00 [DEBUG   ] Finished updating board flags in 1.988 seconds
2019-01-16 08:35:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:35:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:35:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:35:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:35:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:35:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:35:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:35:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:35:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:35:59 [DEBUG   ] Finished updating board flags in 1.305 seconds
2019-01-16 08:36:05 [DEBUG   ] Got command RPT from MCS: ref #1184392
2019-01-16 08:36:05 [DEBUG   ] summary = ERROR
2019-01-16 08:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184392  13 58499 30965273 A  ERRORERROR'
2019-01-16 08:36:05 [DEBUG   ] Got command RPT from MCS: ref #1184393
2019-01-16 08:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184393  77 58499 30965274 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:36:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:36:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:36:39 [DEBUG   ] Got command RPT from MCS: ref #1184411
2019-01-16 08:36:39 [DEBUG   ] summary = ERROR
2019-01-16 08:36:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184411  13 58499 30999345 A  ERRORERROR'
2019-01-16 08:36:39 [DEBUG   ] Got command RPT from MCS: ref #1184412
2019-01-16 08:36:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:36:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184412  77 58499 30999537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:36:39 [DEBUG   ] Got command RPT from MCS: ref #1184413
2019-01-16 08:36:39 [DEBUG   ] summary = ERROR
2019-01-16 08:36:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184413  13 58499 30999741 A  ERRORERROR'
2019-01-16 08:36:39 [DEBUG   ] Got command RPT from MCS: ref #1184415
2019-01-16 08:36:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:36:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184415  77 58499 30999945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:36:40 [DEBUG   ] Got command RPT from MCS: ref #1184417
2019-01-16 08:36:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 08:36:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184417  12 58499 31000149 A  ERRORB˜™š'
2019-01-16 08:36:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:36:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:36:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 08:36:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:36:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:36:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:36:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:36:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:36:59 [DEBUG   ] Finished updating board flags in 1.158 seconds
2019-01-16 08:37:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:37:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:37:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:37:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:37:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:37:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:37:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:37:59 [WARNING ] (13, 1, 'bot')
2019-01-16 08:37:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:37:59 [DEBUG   ] Finished updating board flags in 0.969 seconds
2019-01-16 08:38:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:38:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:38:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:38:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:39:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:39:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:39:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:39:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:39:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:39:00 [DEBUG   ] Finished updating board flags in 1.359 seconds
2019-01-16 08:39:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:39:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:39:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:39:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:40:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:40:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:40:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:40:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:40:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:40:00 [DEBUG   ] Finished updating board flags in 1.210 seconds
2019-01-16 08:40:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:40:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:40:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:40:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:41:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:41:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:41:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:41:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:41:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:41:00 [DEBUG   ] Finished updating board flags in 1.232 seconds
2019-01-16 08:41:05 [DEBUG   ] Got command RPT from MCS: ref #1184425
2019-01-16 08:41:05 [DEBUG   ] summary = ERROR
2019-01-16 08:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184425  13 58499 31265269 A  ERRORERROR'
2019-01-16 08:41:05 [DEBUG   ] Got command RPT from MCS: ref #1184426
2019-01-16 08:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184426  77 58499 31265270 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:41:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:41:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:41:39 [DEBUG   ] Got command RPT from MCS: ref #1184442
2019-01-16 08:41:39 [DEBUG   ] summary = ERROR
2019-01-16 08:41:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184442  13 58499 31299425 A  ERRORERROR'
2019-01-16 08:41:39 [DEBUG   ] Got command RPT from MCS: ref #1184443
2019-01-16 08:41:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:41:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184443  77 58499 31299629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:41:39 [DEBUG   ] Got command RPT from MCS: ref #1184444
2019-01-16 08:41:39 [DEBUG   ] summary = ERROR
2019-01-16 08:41:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184444  13 58499 31299833 A  ERRORERROR'
2019-01-16 08:41:40 [DEBUG   ] Got command RPT from MCS: ref #1184445
2019-01-16 08:41:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:41:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184445  77 58499 31300025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:41:40 [DEBUG   ] Got command RPT from MCS: ref #1184446
2019-01-16 08:41:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 08:41:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184446  12 58499 31300229 A  ERRORB˜™š'
2019-01-16 08:41:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:41:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:42:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:42:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:42:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:42:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:42:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:42:00 [DEBUG   ] Finished updating board flags in 1.256 seconds
2019-01-16 08:42:17 [DEBUG   ] Finished updating ant stats in 1.601 seconds
2019-01-16 08:42:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:42:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:42:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:43:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:43:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:43:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:43:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:43:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:43:00 [DEBUG   ] Finished updating board flags in 1.103 seconds
2019-01-16 08:43:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:43:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:43:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:43:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:44:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:44:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:44:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:44:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:44:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:44:00 [DEBUG   ] Finished updating board flags in 1.018 seconds
2019-01-16 08:44:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:44:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:44:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:45:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:45:01 [WARNING ] (13, 1, 'bot')
2019-01-16 08:45:01 [WARNING ] (13, 1, 'bot')
2019-01-16 08:45:01 [WARNING ] (13, 1, 'bot')
2019-01-16 08:45:01 [WARNING ] (13, 1, 'bot')
2019-01-16 08:45:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:45:01 [DEBUG   ] Finished updating board flags in 1.998 seconds
2019-01-16 08:45:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:45:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:45:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:46:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:46:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:46:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:46:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:46:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:46:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:46:00 [DEBUG   ] Finished updating board flags in 1.246 seconds
2019-01-16 08:46:05 [DEBUG   ] Got command RPT from MCS: ref #1184455
2019-01-16 08:46:05 [DEBUG   ] summary = ERROR
2019-01-16 08:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184455  13 58499 31565273 A  ERRORERROR'
2019-01-16 08:46:05 [DEBUG   ] Got command RPT from MCS: ref #1184456
2019-01-16 08:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184456  77 58499 31565274 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:46:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:46:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:46:39 [DEBUG   ] Got command RPT from MCS: ref #1184474
2019-01-16 08:46:39 [DEBUG   ] summary = ERROR
2019-01-16 08:46:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184474  13 58499 31599509 A  ERRORERROR'
2019-01-16 08:46:39 [DEBUG   ] Got command RPT from MCS: ref #1184475
2019-01-16 08:46:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:46:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184475  77 58499 31599713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:46:39 [DEBUG   ] Got command RPT from MCS: ref #1184476
2019-01-16 08:46:39 [DEBUG   ] summary = ERROR
2019-01-16 08:46:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184476  13 58499 31599917 A  ERRORERROR'
2019-01-16 08:46:40 [DEBUG   ] Got command RPT from MCS: ref #1184478
2019-01-16 08:46:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:46:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184478  77 58499 31600109 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:46:40 [DEBUG   ] Got command RPT from MCS: ref #1184479
2019-01-16 08:46:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 08:46:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184479  12 58499 31600313 A  ERRORB˜™š'
2019-01-16 08:46:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:47:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:47:00 [DEBUG   ] Got command RPT from MCS: ref #1184484
2019-01-16 08:47:00 [DEBUG   ] summary = ERROR
2019-01-16 08:47:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184484  13 58499 31620513 A  ERRORERROR'
2019-01-16 08:47:00 [DEBUG   ] Got command RPT from MCS: ref #1184485
2019-01-16 08:47:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:47:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184485  77 58499 31620514 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:47:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:47:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:47:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:47:00 [WARNING ] (13, 1, 'bot')
2019-01-16 08:47:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:47:00 [DEBUG   ] Finished updating board flags in 1.276 seconds
2019-01-16 08:47:05 [DEBUG   ] Got command INI from MCS: ref #1184486
2019-01-16 08:47:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2019-01-16 08:47:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI  1184486   8 58499 31625530 ABOOTING'
2019-01-16 08:47:26 [INFO    ] -------------------
2019-01-16 08:47:26 [INFO    ]  LWA board status
2019-01-16 08:47:26 [INFO    ] -------------------
2019-01-16 08:47:26 [INFO    ] DP 1: 2 lwa27
2019-01-16 08:47:26 [INFO    ] DP 1: 3 lwa24
2019-01-16 08:47:26 [INFO    ] DP 1: 4 lwa23
2019-01-16 08:47:26 [INFO    ] DP 1: 5 lwa18
2019-01-16 08:47:26 [INFO    ] DP 1: 6 lwa10
2019-01-16 08:47:26 [INFO    ] DP 1: 7 lwa32
2019-01-16 08:47:26 [INFO    ] DP 1: 8 lwa11
2019-01-16 08:47:26 [INFO    ] DP 1: 9 lwa30
2019-01-16 08:47:26 [INFO    ] DP 1: 10 lwa12
2019-01-16 08:47:26 [INFO    ] DP 1: 11 lwa8
2019-01-16 08:47:26 [INFO    ] DP 1: 12 lwa13
2019-01-16 08:47:26 [INFO    ] DP 1: 13 lwa26
2019-01-16 08:47:26 [INFO    ] DP 1: 14 lwa14
2019-01-16 08:47:26 [INFO    ] DP 1: 16 lwa22
2019-01-16 08:47:26 [INFO    ] DP 1: 17 lwa20
2019-01-16 08:47:26 [INFO    ] DP 1: 18 lwa1
2019-01-16 08:47:26 [INFO    ] DP 1: 19 lwa5
2019-01-16 08:47:26 [INFO    ] DP 1: 20 lwa25
2019-01-16 08:47:26 [INFO    ] DP 1: 21 lwa35
2019-01-16 08:47:26 [INFO    ] DP 1: 22 lwa19
2019-01-16 08:47:26 [INFO    ] DP 1: 23 lwa21
2019-01-16 08:47:26 [INFO    ] DP 1: 24 lwa6
2019-01-16 08:47:26 [INFO    ] DP 1: 25 lwa7
2019-01-16 08:47:26 [INFO    ] DP 1: 26 lwa33
2019-01-16 08:47:26 [INFO    ] DP 1: 27 lwa15
2019-01-16 08:47:26 [INFO    ] DP 1: 28 lwa28
2019-01-16 08:47:26 [INFO    ] DP 2: 1 lwa16
2019-01-16 08:47:26 [INFO    ] DP 2: 15 lwa34
2019-01-16 08:47:26 [INFO    ] Total of 28 boards
2019-01-16 08:47:26 [INFO    ] Total of 260 stands
2019-01-16 08:47:26 [INFO    ] -------------------
2019-01-16 08:47:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28619
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28620
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28621
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28622
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28623
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28624
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28625
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28626
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28627
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28628
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28629
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28630
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28631
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28632
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28633
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28634
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28635
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28636
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28637
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28638
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28639
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28640
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28641
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28642
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28643
2019-01-16 08:47:33 [DEBUG   ] 2019-01-16 08:47:33 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28644
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28619 exited with status 0
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28620 exited with status 0
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28621 exited with status 0
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28622 exited with status 0
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28623 exited with status 0
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28624 exited with status 0
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28625 exited with status 0
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28626 exited with status 0
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28627 exited with status 0
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28628 exited with status 0
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28629 exited with status 0
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28630 exited with status 0
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28631 exited with status 0
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28632 exited with status 0
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28633 exited with status 0
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28634 exited with status 0
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28635 exited with status 0
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28636 exited with status 0
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28637 exited with status 0
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28638 exited with status 0
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28639 exited with status 0
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28640 exited with status 0
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28641 exited with status 0
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28642 exited with status 0
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28643 exited with status 0
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28644 exited with status 0
2019-01-16 08:47:45 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] spawn_process: at 2019-01-16 08:47:45 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 28671
2019-01-16 08:47:45 [DEBUG   ] 2019-01-16 08:47:45 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 28672
2019-01-16 08:47:51 [DEBUG   ] 2019-01-16 08:47:51 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 28671 exited with status 0
2019-01-16 08:47:51 [DEBUG   ] 2019-01-16 08:47:51 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 28672 exited with status 0
2019-01-16 08:47:51 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2019-01-16 08:47:51 [DEBUG   ] spawn_process: at 2019-01-16 08:47:51 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2019-01-16 08:47:51 [DEBUG   ] spawn_process: at 2019-01-16 08:47:51 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2019-01-16 08:47:51 [INFO    ] Setting Beam 1 xbars
2019-01-16 08:47:51 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2019-01-16 08:47:51 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2019-01-16 08:47:51 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2019-01-16 08:47:51 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2019-01-16 08:47:51 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2019-01-16 08:47:52 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2019-01-16 08:47:52 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2019-01-16 08:47:52 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2019-01-16 08:47:52 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2019-01-16 08:47:52 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2019-01-16 08:47:52 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2019-01-16 08:47:52 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2019-01-16 08:47:52 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2019-01-16 08:47:52 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2019-01-16 08:47:52 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2019-01-16 08:47:53 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2019-01-16 08:47:53 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2019-01-16 08:47:53 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2019-01-16 08:47:53 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2019-01-16 08:47:53 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2019-01-16 08:47:53 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2019-01-16 08:47:53 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2019-01-16 08:47:53 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2019-01-16 08:47:53 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2019-01-16 08:47:54 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2019-01-16 08:47:54 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2019-01-16 08:47:54 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2019-01-16 08:47:54 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2019-01-16 08:47:54 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2019-01-16 08:47:54 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2019-01-16 08:47:54 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2019-01-16 08:47:54 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2019-01-16 08:47:54 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2019-01-16 08:47:55 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2019-01-16 08:47:55 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2019-01-16 08:47:55 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2019-01-16 08:47:55 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2019-01-16 08:47:55 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2019-01-16 08:47:55 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2019-01-16 08:47:55 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2019-01-16 08:47:55 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2019-01-16 08:47:55 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2019-01-16 08:47:56 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2019-01-16 08:47:56 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2019-01-16 08:47:56 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2019-01-16 08:47:56 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2019-01-16 08:47:56 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2019-01-16 08:47:56 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2019-01-16 08:47:56 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2019-01-16 08:47:56 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2019-01-16 08:47:56 [INFO    ] Setting Beam 2 xbars
2019-01-16 08:47:56 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2019-01-16 08:47:56 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2019-01-16 08:47:57 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2019-01-16 08:47:57 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2019-01-16 08:47:57 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2019-01-16 08:47:57 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2019-01-16 08:47:57 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2019-01-16 08:47:57 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2019-01-16 08:47:57 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2019-01-16 08:47:57 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2019-01-16 08:47:57 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2019-01-16 08:47:58 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2019-01-16 08:47:58 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2019-01-16 08:47:58 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2019-01-16 08:47:58 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2019-01-16 08:47:58 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2019-01-16 08:47:58 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2019-01-16 08:47:58 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2019-01-16 08:47:58 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2019-01-16 08:47:58 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2019-01-16 08:47:59 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2019-01-16 08:47:59 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2019-01-16 08:47:59 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2019-01-16 08:47:59 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2019-01-16 08:47:59 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2019-01-16 08:47:59 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2019-01-16 08:47:59 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2019-01-16 08:47:59 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2019-01-16 08:47:59 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2019-01-16 08:48:00 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2019-01-16 08:48:00 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2019-01-16 08:48:00 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2019-01-16 08:48:00 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2019-01-16 08:48:00 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2019-01-16 08:48:00 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2019-01-16 08:48:00 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2019-01-16 08:48:01 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2019-01-16 08:48:01 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2019-01-16 08:48:01 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2019-01-16 08:48:01 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2019-01-16 08:48:01 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2019-01-16 08:48:01 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2019-01-16 08:48:01 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2019-01-16 08:48:01 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2019-01-16 08:48:01 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2019-01-16 08:48:02 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2019-01-16 08:48:02 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2019-01-16 08:48:02 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2019-01-16 08:48:02 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2019-01-16 08:48:02 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2019-01-16 08:48:02 [INFO    ] Setting Beam 3 xbars
2019-01-16 08:48:02 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2019-01-16 08:48:02 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2019-01-16 08:48:02 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2019-01-16 08:48:02 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2019-01-16 08:48:03 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2019-01-16 08:48:03 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2019-01-16 08:48:03 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2019-01-16 08:48:03 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2019-01-16 08:48:03 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2019-01-16 08:48:03 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2019-01-16 08:48:03 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2019-01-16 08:48:03 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2019-01-16 08:48:03 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2019-01-16 08:48:04 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2019-01-16 08:48:04 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2019-01-16 08:48:04 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2019-01-16 08:48:04 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2019-01-16 08:48:04 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2019-01-16 08:48:04 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2019-01-16 08:48:04 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2019-01-16 08:48:04 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2019-01-16 08:48:04 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2019-01-16 08:48:05 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2019-01-16 08:48:05 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2019-01-16 08:48:05 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2019-01-16 08:48:05 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2019-01-16 08:48:05 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2019-01-16 08:48:05 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2019-01-16 08:48:05 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2019-01-16 08:48:05 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2019-01-16 08:48:05 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2019-01-16 08:48:06 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2019-01-16 08:48:06 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2019-01-16 08:48:06 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2019-01-16 08:48:06 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2019-01-16 08:48:06 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2019-01-16 08:48:06 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2019-01-16 08:48:06 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2019-01-16 08:48:06 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2019-01-16 08:48:06 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2019-01-16 08:48:06 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2019-01-16 08:48:07 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2019-01-16 08:48:07 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2019-01-16 08:48:07 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2019-01-16 08:48:07 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2019-01-16 08:48:07 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2019-01-16 08:48:07 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2019-01-16 08:48:07 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2019-01-16 08:48:07 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2019-01-16 08:48:07 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2019-01-16 08:48:08 [INFO    ] Setting Beam 4 xbars
2019-01-16 08:48:08 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2019-01-16 08:48:08 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-01-16 08:48:08 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-01-16 08:48:08 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-01-16 08:48:08 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-01-16 08:48:08 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2019-01-16 08:48:08 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2019-01-16 08:48:08 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2019-01-16 08:48:08 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2019-01-16 08:48:09 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2019-01-16 08:48:09 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2019-01-16 08:48:09 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2019-01-16 08:48:09 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2019-01-16 08:48:09 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2019-01-16 08:48:09 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2019-01-16 08:48:09 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2019-01-16 08:48:09 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2019-01-16 08:48:09 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2019-01-16 08:48:10 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2019-01-16 08:48:10 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2019-01-16 08:48:10 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2019-01-16 08:48:10 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2019-01-16 08:48:10 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2019-01-16 08:48:10 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2019-01-16 08:48:10 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2019-01-16 08:48:10 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2019-01-16 08:48:10 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2019-01-16 08:48:10 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2019-01-16 08:48:11 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2019-01-16 08:48:11 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2019-01-16 08:48:11 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2019-01-16 08:48:11 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2019-01-16 08:48:11 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2019-01-16 08:48:11 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2019-01-16 08:48:11 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2019-01-16 08:48:11 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2019-01-16 08:48:11 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2019-01-16 08:48:12 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2019-01-16 08:48:12 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2019-01-16 08:48:12 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2019-01-16 08:48:12 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2019-01-16 08:48:12 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2019-01-16 08:48:12 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2019-01-16 08:48:12 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2019-01-16 08:48:12 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2019-01-16 08:48:12 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2019-01-16 08:48:13 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2019-01-16 08:48:13 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2019-01-16 08:48:13 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2019-01-16 08:48:13 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2019-01-16 08:48:13 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2019-01-16 08:48:13 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2019-01-16 08:48:13 [INFO    ] All xbars set
2019-01-16 08:48:13 [INFO    ] Setting adder chain routing for all beams
2019-01-16 08:48:18 [INFO    ] Setting beam ids
2019-01-16 08:48:28 [INFO    ] Starting beam delay calibration
2019-01-16 08:48:40 [INFO    ] Beam 1 latency is 5747
2019-01-16 08:48:40 [INFO    ] Beam 2 latency is 5750
2019-01-16 08:48:40 [INFO    ] Beam 3 latency is 5732
2019-01-16 08:48:40 [INFO    ] Beam 4 latency is 5746
2019-01-16 08:48:40 [INFO    ] Stop calibration
2019-01-16 08:48:49 [INFO    ] Beam delay calibration successful
2019-01-16 08:48:49 [INFO    ] Calibration passed
2019-01-16 08:48:49 [DEBUG   ] spawn_process: at 2019-01-16 08:48:49 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2019-01-16 08:48:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2019-01-16 08:48:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2019-01-16 08:48:49 [DEBUG   ] spawn_process: at 2019-01-16 08:48:49 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2019-01-16 08:48:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2019-01-16 08:48:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2019-01-16 08:48:49 [DEBUG   ] spawn_process: at 2019-01-16 08:48:49 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2019-01-16 08:48:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2019-01-16 08:48:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2019-01-16 08:48:49 [DEBUG   ] spawn_process: at 2019-01-16 08:48:49 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2019-01-16 08:48:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2019-01-16 08:48:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2019-01-16 08:48:49 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2019-01-16 08:48:49 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 421 ms (1547628529.423 s) with PID 30237 and time 1547628530
2019-01-16 08:48:49 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2019-01-16 08:48:49 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 508 ms (1547628529.510 s) with PID 30240 and time 1547628530
2019-01-16 08:48:50 [DEBUG   ] Finished updating ant stats in 0.737 seconds
2019-01-16 08:48:50 [INFO    ] Started antennas statistics background thread
2019-01-16 08:48:50 [INFO    ] Started board flags background thread
2019-01-16 08:48:50 [INFO    ] Started BAM background thread
2019-01-16 08:48:50 [INFO    ] Finished the INI process (ref. #1184486) in 105.105 s
2019-01-16 08:48:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:48:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 08:48:51 [WARNING ] (13, 1, 'bot')
2019-01-16 08:48:51 [WARNING ] (13, 1, 'bot')
2019-01-16 08:48:51 [WARNING ] (13, 1, 'bot')
2019-01-16 08:48:51 [WARNING ] (13, 1, 'bot')
2019-01-16 08:48:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:48:51 [DEBUG   ] Finished updating board flags in 1.374 seconds
2019-01-16 08:49:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:49:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:49:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:49:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 08:49:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:49:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 08:49:51 [WARNING ] (13, 1, 'bot')
2019-01-16 08:49:51 [WARNING ] (13, 1, 'bot')
2019-01-16 08:49:51 [WARNING ] (13, 1, 'bot')
2019-01-16 08:49:51 [WARNING ] (13, 1, 'bot')
2019-01-16 08:49:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:49:51 [DEBUG   ] Finished updating board flags in 1.193 seconds
2019-01-16 08:50:05 [DEBUG   ] Got command RPT from MCS: ref #1184491
2019-01-16 08:50:05 [DEBUG   ] summary = ERROR
2019-01-16 08:50:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184491  13 58499 31805525 A  ERRORERROR'
2019-01-16 08:50:05 [DEBUG   ] Got command RPT from MCS: ref #1184492
2019-01-16 08:50:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:50:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184492  77 58499 31805526 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:50:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:50:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:50:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:50:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:50:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:50:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:50:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:50:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:50:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:50:52 [DEBUG   ] Finished updating board flags in 1.564 seconds
2019-01-16 08:51:05 [DEBUG   ] Got command RPT from MCS: ref #1184497
2019-01-16 08:51:05 [DEBUG   ] summary = ERROR
2019-01-16 08:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184497  13 58499 31865277 A  ERRORERROR'
2019-01-16 08:51:05 [DEBUG   ] Got command RPT from MCS: ref #1184498
2019-01-16 08:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184498  77 58499 31865278 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:51:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:51:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 08:51:39 [DEBUG   ] Got command RPT from MCS: ref #1184514
2019-01-16 08:51:39 [DEBUG   ] summary = ERROR
2019-01-16 08:51:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184514  13 58499 31899601 A  ERRORERROR'
2019-01-16 08:51:39 [DEBUG   ] Got command RPT from MCS: ref #1184515
2019-01-16 08:51:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:51:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184515  77 58499 31899793 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:51:39 [DEBUG   ] Got command RPT from MCS: ref #1184516
2019-01-16 08:51:39 [DEBUG   ] summary = ERROR
2019-01-16 08:51:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184516  13 58499 31899997 A  ERRORERROR'
2019-01-16 08:51:40 [DEBUG   ] Got command RPT from MCS: ref #1184517
2019-01-16 08:51:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:51:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184517  77 58499 31900201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:51:40 [DEBUG   ] Got command RPT from MCS: ref #1184518
2019-01-16 08:51:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 08:51:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184518  12 58499 31900405 A  ERRORB—™š'
2019-01-16 08:51:50 [DEBUG   ] Finished updating ant stats in 0.590 seconds
2019-01-16 08:51:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:51:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:51:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:51:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:51:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:51:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:51:52 [DEBUG   ] Finished updating board flags in 1.408 seconds
2019-01-16 08:52:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 08:52:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 08:52:50 [DEBUG   ] Finished updating ant stats in 0.394 seconds
2019-01-16 08:52:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:52:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:52:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:52:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:52:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:52:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:52:52 [DEBUG   ] Finished updating board flags in 1.383 seconds
2019-01-16 08:53:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 08:53:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 08:53:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 08:53:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:53:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:53:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:53:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:53:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:53:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:53:52 [DEBUG   ] Finished updating board flags in 1.217 seconds
2019-01-16 08:54:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 08:54:31 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-16 08:54:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 08:54:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:54:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:54:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:54:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:54:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:54:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:54:52 [DEBUG   ] Finished updating board flags in 1.183 seconds
2019-01-16 08:55:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:55:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:55:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:55:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 08:55:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:55:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:55:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:55:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:55:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:55:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:55:52 [DEBUG   ] Finished updating board flags in 1.085 seconds
2019-01-16 08:56:05 [DEBUG   ] Got command RPT from MCS: ref #1184523
2019-01-16 08:56:05 [DEBUG   ] summary = ERROR
2019-01-16 08:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184523  13 58499 32165269 A  ERRORERROR'
2019-01-16 08:56:05 [DEBUG   ] Got command RPT from MCS: ref #1184524
2019-01-16 08:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184524  77 58499 32165270 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:56:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:56:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:56:39 [DEBUG   ] Got command RPT from MCS: ref #1184542
2019-01-16 08:56:39 [DEBUG   ] summary = ERROR
2019-01-16 08:56:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184542  13 58499 32199685 A  ERRORERROR'
2019-01-16 08:56:39 [DEBUG   ] Got command RPT from MCS: ref #1184543
2019-01-16 08:56:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:56:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184543  77 58499 32199889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:56:40 [DEBUG   ] Got command RPT from MCS: ref #1184544
2019-01-16 08:56:40 [DEBUG   ] summary = ERROR
2019-01-16 08:56:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184544  13 58499 32200081 A  ERRORERROR'
2019-01-16 08:56:40 [DEBUG   ] Got command RPT from MCS: ref #1184546
2019-01-16 08:56:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 08:56:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184546  77 58499 32200285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 08:56:40 [DEBUG   ] Got command RPT from MCS: ref #1184547
2019-01-16 08:56:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 08:56:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184547  12 58499 32200489 A  ERRORB˜™š'
2019-01-16 08:56:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:56:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:56:53 [WARNING ] (13, 1, 'bot')
2019-01-16 08:56:53 [WARNING ] (13, 1, 'bot')
2019-01-16 08:56:53 [WARNING ] (13, 1, 'bot')
2019-01-16 08:56:53 [WARNING ] (13, 1, 'bot')
2019-01-16 08:56:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:56:53 [DEBUG   ] Finished updating board flags in 2.001 seconds
2019-01-16 08:57:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:57:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:57:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:57:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:57:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 08:57:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:57:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:57:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:57:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:57:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:57:52 [DEBUG   ] Finished updating board flags in 1.376 seconds
2019-01-16 08:58:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:58:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 08:58:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:58:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:58:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:58:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:58:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:58:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:58:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:58:52 [DEBUG   ] Finished updating board flags in 1.229 seconds
2019-01-16 08:59:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:59:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:59:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 08:59:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 08:59:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:59:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:59:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:59:52 [WARNING ] (13, 1, 'bot')
2019-01-16 08:59:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 08:59:52 [DEBUG   ] Finished updating board flags in 1.206 seconds
2019-01-16 09:00:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 09:00:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 09:00:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 09:00:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:00:52 [WARNING ] (13, 1, 'bot')
2019-01-16 09:00:52 [WARNING ] (13, 1, 'bot')
2019-01-16 09:00:52 [WARNING ] (13, 1, 'bot')
2019-01-16 09:00:52 [WARNING ] (13, 1, 'bot')
2019-01-16 09:00:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:00:52 [DEBUG   ] Finished updating board flags in 1.208 seconds
2019-01-16 09:01:05 [DEBUG   ] Got command RPT from MCS: ref #1184560
2019-01-16 09:01:05 [DEBUG   ] summary = ERROR
2019-01-16 09:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184560  13 58499 32465277 A  ERRORERROR'
2019-01-16 09:01:05 [DEBUG   ] Got command RPT from MCS: ref #1184561
2019-01-16 09:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184561  77 58499 32465278 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:01:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 09:01:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 09:01:39 [DEBUG   ] Got command RPT from MCS: ref #1184577
2019-01-16 09:01:39 [DEBUG   ] summary = ERROR
2019-01-16 09:01:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184577  13 58499 32499765 A  ERRORERROR'
2019-01-16 09:01:39 [DEBUG   ] Got command RPT from MCS: ref #1184578
2019-01-16 09:01:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:01:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184578  77 58499 32499969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:01:40 [DEBUG   ] Got command RPT from MCS: ref #1184579
2019-01-16 09:01:40 [DEBUG   ] summary = ERROR
2019-01-16 09:01:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184579  13 58499 32500173 A  ERRORERROR'
2019-01-16 09:01:40 [DEBUG   ] Got command RPT from MCS: ref #1184580
2019-01-16 09:01:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:01:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184580  77 58499 32500365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:01:40 [DEBUG   ] Got command RPT from MCS: ref #1184581
2019-01-16 09:01:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 09:01:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184581  12 58499 32500569 A  ERRORB˜™š'
2019-01-16 09:01:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 09:01:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:01:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:01:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:01:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:01:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:01:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:01:53 [DEBUG   ] Finished updating board flags in 1.793 seconds
2019-01-16 09:02:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 09:02:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 09:02:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 09:02:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:02:52 [WARNING ] (13, 1, 'bot')
2019-01-16 09:02:52 [WARNING ] (13, 1, 'bot')
2019-01-16 09:02:52 [WARNING ] (13, 1, 'bot')
2019-01-16 09:02:52 [WARNING ] (13, 1, 'bot')
2019-01-16 09:02:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:02:52 [DEBUG   ] Finished updating board flags in 0.971 seconds
2019-01-16 09:03:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 09:03:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 09:03:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 09:03:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:03:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:03:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:03:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:03:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:03:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:03:53 [DEBUG   ] Finished updating board flags in 1.368 seconds
2019-01-16 09:04:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 09:04:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 09:04:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 09:04:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 09:04:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:04:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 09:04:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:04:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:04:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:04:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:04:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:04:53 [DEBUG   ] Finished updating board flags in 1.194 seconds
2019-01-16 09:05:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 09:05:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 09:05:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 09:05:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:05:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:05:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:05:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:05:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:05:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:05:53 [DEBUG   ] Finished updating board flags in 1.004 seconds
2019-01-16 09:06:05 [DEBUG   ] Got command RPT from MCS: ref #1184590
2019-01-16 09:06:05 [DEBUG   ] summary = ERROR
2019-01-16 09:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184590  13 58499 32765277 A  ERRORERROR'
2019-01-16 09:06:05 [DEBUG   ] Got command RPT from MCS: ref #1184591
2019-01-16 09:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184591  77 58499 32765278 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:06:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 09:06:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 09:06:39 [DEBUG   ] Got command RPT from MCS: ref #1184609
2019-01-16 09:06:39 [DEBUG   ] summary = ERROR
2019-01-16 09:06:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184609  13 58499 32799853 A  ERRORERROR'
2019-01-16 09:06:40 [DEBUG   ] Got command RPT from MCS: ref #1184610
2019-01-16 09:06:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:06:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184610  77 58499 32800057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:06:40 [DEBUG   ] Got command RPT from MCS: ref #1184611
2019-01-16 09:06:40 [DEBUG   ] summary = ERROR
2019-01-16 09:06:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184611  13 58499 32800261 A  ERRORERROR'
2019-01-16 09:06:40 [DEBUG   ] Got command RPT from MCS: ref #1184613
2019-01-16 09:06:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:06:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184613  77 58499 32800453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:06:40 [DEBUG   ] Got command RPT from MCS: ref #1184614
2019-01-16 09:06:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 09:06:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184614  12 58499 32800657 A  ERRORB™™š'
2019-01-16 09:06:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 09:06:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:06:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 09:06:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:06:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:06:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:06:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:06:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:06:53 [DEBUG   ] Finished updating board flags in 1.080 seconds
2019-01-16 09:07:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 09:07:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 09:07:32 [DEBUG   ] Got command DRX from MCS: ref #1184624
2019-01-16 09:07:32 [INFO    ] sending drx command to lwa16
2019-01-16 09:07:32 [DEBUG   ] run_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 64500000.0 7 9 0']
2019-01-16 09:07:32 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-16 09:07:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1184624   8 58499 32852006 A  ERROR'
2019-01-16 09:07:32 [DEBUG   ] Got command DRX from MCS: ref #1184623
2019-01-16 09:07:32 [INFO    ] sending drx command to lwa34
2019-01-16 09:07:32 [DEBUG   ] run_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 35100000.0 7 9 0']
2019-01-16 09:07:32 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-16 09:07:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1184623   8 58499 32852010 A  ERROR'
2019-01-16 09:07:32 [DEBUG   ] Got command DRX from MCS: ref #1184625
2019-01-16 09:07:32 [INFO    ] sending drx command to lwa34
2019-01-16 09:07:32 [DEBUG   ] run_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 49800000.0 7 9 0']
2019-01-16 09:07:32 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-16 09:07:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1184625   8 58499 32852014 A  ERROR'
2019-01-16 09:07:32 [DEBUG   ] Got command DRX from MCS: ref #1184626
2019-01-16 09:07:32 [INFO    ] sending drx command to lwa16
2019-01-16 09:07:32 [DEBUG   ] run_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 79200000.0 7 9 0']
2019-01-16 09:07:32 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-16 09:07:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1184626   8 58499 32852018 A  ERROR'
2019-01-16 09:07:32 [DEBUG   ] Got command BAM from MCS: ref #1184627
2019-01-16 09:07:32 [INFO    ] Finished processing BAM request
2019-01-16 09:07:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:07:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184627   8 58499 32852033 A  ERROR'
2019-01-16 09:07:32 [DEBUG   ] Got command BAM from MCS: ref #1184628
2019-01-16 09:07:32 [INFO    ] Finished processing BAM request
2019-01-16 09:07:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:07:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184628   8 58499 32852037 A  ERROR'
2019-01-16 09:07:32 [INFO    ] Finished starting DRX
2019-01-16 09:07:32 [INFO    ] Finished starting DRX
2019-01-16 09:07:32 [INFO    ] Finished starting DRX
2019-01-16 09:07:32 [INFO    ] Finished starting DRX
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 09:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 09:07:32 [DEBUG   ] spawn_process: at 2019-01-16 09:07:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 09:07:51 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-16 09:07:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 09:07:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:07:54 [DEBUG   ] Got command BAM from MCS: ref #1184632
2019-01-16 09:07:54 [INFO    ] Finished processing BAM request
2019-01-16 09:07:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:07:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184632   8 58499 32874026 A  ERROR'
2019-01-16 09:07:54 [DEBUG   ] Got command BAM from MCS: ref #1184631
2019-01-16 09:07:54 [INFO    ] Finished processing BAM request
2019-01-16 09:07:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:07:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184631   8 58499 32874029 A  ERROR'
2019-01-16 09:07:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:07:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:07:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:07:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:07:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:07:54 [DEBUG   ] Finished updating board flags in 2.006 seconds
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 09:07:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 09:07:54 [DEBUG   ] spawn_process: at 2019-01-16 09:07:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 09:08:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:08:16 [DEBUG   ] Got command BAM from MCS: ref #1184634
2019-01-16 09:08:16 [INFO    ] Finished processing BAM request
2019-01-16 09:08:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:08:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184634   8 58499 32896033 A  ERROR'
2019-01-16 09:08:16 [DEBUG   ] Got command BAM from MCS: ref #1184633
2019-01-16 09:08:16 [INFO    ] Finished processing BAM request
2019-01-16 09:08:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:08:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184633   8 58499 32896037 A  ERROR'
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:08:16 [DEBUG   ] spawn_process: at 2019-01-16 09:08:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:08:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:08:38 [DEBUG   ] Got command BAM from MCS: ref #1184636
2019-01-16 09:08:38 [INFO    ] Finished processing BAM request
2019-01-16 09:08:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:08:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184636   8 58499 32918033 A  ERROR'
2019-01-16 09:08:38 [DEBUG   ] Got command BAM from MCS: ref #1184635
2019-01-16 09:08:38 [INFO    ] Finished processing BAM request
2019-01-16 09:08:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:08:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184635   8 58499 32918037 A  ERROR'
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 09:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 09:08:38 [DEBUG   ] spawn_process: at 2019-01-16 09:08:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 09:08:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 09:08:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:08:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:08:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:08:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:08:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:08:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:08:53 [DEBUG   ] Finished updating board flags in 1.355 seconds
2019-01-16 09:09:00 [DEBUG   ] Got command BAM from MCS: ref #1184641
2019-01-16 09:09:00 [INFO    ] Finished processing BAM request
2019-01-16 09:09:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:09:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184641   8 58499 32940029 A  ERROR'
2019-01-16 09:09:00 [DEBUG   ] Got command BAM from MCS: ref #1184642
2019-01-16 09:09:00 [INFO    ] Finished processing BAM request
2019-01-16 09:09:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:09:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184642   8 58499 32940033 A  ERROR'
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:09:00 [DEBUG   ] spawn_process: at 2019-01-16 09:09:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:09:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:09:22 [DEBUG   ] Got command BAM from MCS: ref #1184644
2019-01-16 09:09:22 [INFO    ] Finished processing BAM request
2019-01-16 09:09:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:09:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184644   8 58499 32962025 A  ERROR'
2019-01-16 09:09:22 [DEBUG   ] Got command BAM from MCS: ref #1184643
2019-01-16 09:09:22 [INFO    ] Finished processing BAM request
2019-01-16 09:09:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:09:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184643   8 58499 32962029 A  ERROR'
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 09:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 09:09:22 [DEBUG   ] spawn_process: at 2019-01-16 09:09:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 09:09:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:09:44 [DEBUG   ] Got command BAM from MCS: ref #1184645
2019-01-16 09:09:44 [INFO    ] Finished processing BAM request
2019-01-16 09:09:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:09:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184645   8 58499 32984029 A  ERROR'
2019-01-16 09:09:44 [DEBUG   ] Got command BAM from MCS: ref #1184646
2019-01-16 09:09:44 [INFO    ] Finished processing BAM request
2019-01-16 09:09:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:09:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184646   8 58499 32984033 A  ERROR'
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:09:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:09:44 [DEBUG   ] spawn_process: at 2019-01-16 09:09:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:09:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:09:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 09:09:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:09:53 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-16 09:09:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-16 09:09:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 09:09:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:09:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:09:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:09:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:09:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:09:53 [DEBUG   ] Finished updating board flags in 1.214 seconds
2019-01-16 09:10:06 [DEBUG   ] Got command BAM from MCS: ref #1184648
2019-01-16 09:10:06 [INFO    ] Finished processing BAM request
2019-01-16 09:10:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:10:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184648   8 58499 33006033 A  ERROR'
2019-01-16 09:10:06 [DEBUG   ] Got command BAM from MCS: ref #1184647
2019-01-16 09:10:06 [INFO    ] Finished processing BAM request
2019-01-16 09:10:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:10:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184647   8 58499 33006037 A  ERROR'
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 09:10:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 09:10:06 [DEBUG   ] spawn_process: at 2019-01-16 09:10:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 09:10:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 09:10:28 [DEBUG   ] Got command BAM from MCS: ref #1184649
2019-01-16 09:10:28 [INFO    ] Finished processing BAM request
2019-01-16 09:10:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:10:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184649   8 58499 33028033 A  ERROR'
2019-01-16 09:10:28 [DEBUG   ] Got command BAM from MCS: ref #1184650
2019-01-16 09:10:28 [INFO    ] Finished processing BAM request
2019-01-16 09:10:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:10:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184650   8 58499 33028037 A  ERROR'
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:10:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:10:28 [DEBUG   ] spawn_process: at 2019-01-16 09:10:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:10:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:10:50 [DEBUG   ] Got command BAM from MCS: ref #1184651
2019-01-16 09:10:50 [INFO    ] Finished processing BAM request
2019-01-16 09:10:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:10:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184651   8 58499 33050025 A  ERROR'
2019-01-16 09:10:50 [DEBUG   ] Got command BAM from MCS: ref #1184652
2019-01-16 09:10:50 [INFO    ] Finished processing BAM request
2019-01-16 09:10:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:10:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184652   8 58499 33050029 A  ERROR'
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 09:10:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 09:10:50 [DEBUG   ] spawn_process: at 2019-01-16 09:10:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 09:10:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:10:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 09:10:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:10:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:10:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:10:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:10:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:10:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:10:53 [DEBUG   ] Finished updating board flags in 1.189 seconds
2019-01-16 09:11:05 [DEBUG   ] Got command RPT from MCS: ref #1184653
2019-01-16 09:11:05 [DEBUG   ] summary = ERROR
2019-01-16 09:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184653  13 58499 33065273 A  ERRORERROR'
2019-01-16 09:11:05 [DEBUG   ] Got command RPT from MCS: ref #1184654
2019-01-16 09:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184654  77 58499 33065274 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:11:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:11:12 [DEBUG   ] Got command BAM from MCS: ref #1184671
2019-01-16 09:11:12 [INFO    ] Finished processing BAM request
2019-01-16 09:11:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184671   8 58499 33072033 A  ERROR'
2019-01-16 09:11:12 [DEBUG   ] Got command BAM from MCS: ref #1184670
2019-01-16 09:11:12 [INFO    ] Finished processing BAM request
2019-01-16 09:11:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184670   8 58499 33072037 A  ERROR'
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:11:12 [DEBUG   ] spawn_process: at 2019-01-16 09:11:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:11:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:11:34 [DEBUG   ] Got command BAM from MCS: ref #1184672
2019-01-16 09:11:34 [INFO    ] Finished processing BAM request
2019-01-16 09:11:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:11:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184672   8 58499 33094033 A  ERROR'
2019-01-16 09:11:34 [DEBUG   ] Got command BAM from MCS: ref #1184673
2019-01-16 09:11:34 [INFO    ] Finished processing BAM request
2019-01-16 09:11:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:11:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184673   8 58499 33094037 A  ERROR'
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 09:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 09:11:34 [DEBUG   ] spawn_process: at 2019-01-16 09:11:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 09:11:39 [DEBUG   ] Got command RPT from MCS: ref #1184674
2019-01-16 09:11:39 [DEBUG   ] summary = ERROR
2019-01-16 09:11:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184674  13 58499 33099941 A  ERRORERROR'
2019-01-16 09:11:40 [DEBUG   ] Got command RPT from MCS: ref #1184675
2019-01-16 09:11:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:11:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184675  77 58499 33100145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:11:40 [DEBUG   ] Got command RPT from MCS: ref #1184676
2019-01-16 09:11:40 [DEBUG   ] summary = ERROR
2019-01-16 09:11:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184676  13 58499 33100337 A  ERRORERROR'
2019-01-16 09:11:40 [DEBUG   ] Got command RPT from MCS: ref #1184677
2019-01-16 09:11:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:11:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184677  77 58499 33100541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:11:40 [DEBUG   ] Got command RPT from MCS: ref #1184678
2019-01-16 09:11:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 09:11:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184678  12 58499 33100745 A  ERRORBŸff'
2019-01-16 09:11:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:11:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-01-16 09:11:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:11:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:11:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:11:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:11:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:11:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:11:53 [DEBUG   ] Finished updating board flags in 1.036 seconds
2019-01-16 09:11:56 [DEBUG   ] Got command BAM from MCS: ref #1184684
2019-01-16 09:11:56 [INFO    ] Finished processing BAM request
2019-01-16 09:11:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:11:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184684   8 58499 33116025 A  ERROR'
2019-01-16 09:11:56 [DEBUG   ] Got command BAM from MCS: ref #1184683
2019-01-16 09:11:56 [INFO    ] Finished processing BAM request
2019-01-16 09:11:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:11:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184683   8 58499 33116029 A  ERROR'
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:11:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:11:56 [DEBUG   ] spawn_process: at 2019-01-16 09:11:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:12:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:12:18 [DEBUG   ] Got command BAM from MCS: ref #1184686
2019-01-16 09:12:18 [INFO    ] Finished processing BAM request
2019-01-16 09:12:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:12:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184686   8 58499 33138025 A  ERROR'
2019-01-16 09:12:18 [DEBUG   ] Got command BAM from MCS: ref #1184685
2019-01-16 09:12:18 [INFO    ] Finished processing BAM request
2019-01-16 09:12:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:12:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184685   8 58499 33138029 A  ERROR'
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 09:12:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 09:12:18 [DEBUG   ] spawn_process: at 2019-01-16 09:12:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 09:12:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 09:12:40 [DEBUG   ] Got command BAM from MCS: ref #1184688
2019-01-16 09:12:40 [INFO    ] Finished processing BAM request
2019-01-16 09:12:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184688   8 58499 33160033 A  ERROR'
2019-01-16 09:12:40 [DEBUG   ] Got command BAM from MCS: ref #1184687
2019-01-16 09:12:40 [INFO    ] Finished processing BAM request
2019-01-16 09:12:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184687   8 58499 33160037 A  ERROR'
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:12:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:12:40 [DEBUG   ] spawn_process: at 2019-01-16 09:12:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:12:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:12:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 09:12:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-01-16 09:12:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:12:53 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-16 09:12:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:12:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:12:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:12:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:12:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:12:53 [DEBUG   ] Finished updating board flags in 1.009 seconds
2019-01-16 09:13:02 [DEBUG   ] Got command BAM from MCS: ref #1184690
2019-01-16 09:13:02 [INFO    ] Finished processing BAM request
2019-01-16 09:13:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:13:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184690   8 58499 33182029 A  ERROR'
2019-01-16 09:13:02 [DEBUG   ] Got command BAM from MCS: ref #1184689
2019-01-16 09:13:02 [INFO    ] Finished processing BAM request
2019-01-16 09:13:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:13:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184689   8 58499 33182033 A  ERROR'
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 09:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 09:13:02 [DEBUG   ] spawn_process: at 2019-01-16 09:13:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 09:13:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:13:24 [DEBUG   ] Got command BAM from MCS: ref #1184692
2019-01-16 09:13:24 [INFO    ] Finished processing BAM request
2019-01-16 09:13:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184692   8 58499 33204033 A  ERROR'
2019-01-16 09:13:24 [DEBUG   ] Got command BAM from MCS: ref #1184691
2019-01-16 09:13:24 [INFO    ] Finished processing BAM request
2019-01-16 09:13:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184691   8 58499 33204037 A  ERROR'
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:13:24 [DEBUG   ] spawn_process: at 2019-01-16 09:13:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:13:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:13:46 [DEBUG   ] Got command BAM from MCS: ref #1184694
2019-01-16 09:13:46 [INFO    ] Finished processing BAM request
2019-01-16 09:13:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:13:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184694   8 58499 33226033 A  ERROR'
2019-01-16 09:13:46 [DEBUG   ] Got command BAM from MCS: ref #1184693
2019-01-16 09:13:46 [INFO    ] Finished processing BAM request
2019-01-16 09:13:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:13:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184693   8 58499 33226037 A  ERROR'
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 09:13:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 09:13:46 [DEBUG   ] spawn_process: at 2019-01-16 09:13:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 09:13:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:13:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 09:13:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:13:53 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-16 09:13:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:13:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:13:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:13:53 [WARNING ] (13, 1, 'bot')
2019-01-16 09:13:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:13:53 [DEBUG   ] Finished updating board flags in 0.975 seconds
2019-01-16 09:14:08 [DEBUG   ] Got command BAM from MCS: ref #1184696
2019-01-16 09:14:08 [INFO    ] Finished processing BAM request
2019-01-16 09:14:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:14:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184696   8 58499 33248025 A  ERROR'
2019-01-16 09:14:08 [DEBUG   ] Got command BAM from MCS: ref #1184695
2019-01-16 09:14:08 [INFO    ] Finished processing BAM request
2019-01-16 09:14:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:14:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184695   8 58499 33248029 A  ERROR'
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 09:14:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 09:14:08 [DEBUG   ] spawn_process: at 2019-01-16 09:14:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 09:14:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:14:30 [DEBUG   ] Got command BAM from MCS: ref #1184698
2019-01-16 09:14:30 [INFO    ] Finished processing BAM request
2019-01-16 09:14:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:14:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184698   8 58499 33270029 A  ERROR'
2019-01-16 09:14:30 [DEBUG   ] Got command BAM from MCS: ref #1184697
2019-01-16 09:14:30 [INFO    ] Finished processing BAM request
2019-01-16 09:14:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:14:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184697   8 58499 33270033 A  ERROR'
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 09:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 09:14:30 [DEBUG   ] spawn_process: at 2019-01-16 09:14:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 09:14:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 09:14:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:14:52 [DEBUG   ] Got command BAM from MCS: ref #1184704
2019-01-16 09:14:52 [INFO    ] Finished processing BAM request
2019-01-16 09:14:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:14:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184704   8 58499 33292025 A  ERROR'
2019-01-16 09:14:52 [DEBUG   ] Got command BAM from MCS: ref #1184703
2019-01-16 09:14:52 [INFO    ] Finished processing BAM request
2019-01-16 09:14:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:14:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184703   8 58499 33292029 A  ERROR'
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:14:52 [DEBUG   ] spawn_process: at 2019-01-16 09:14:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:14:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:14:54 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-16 09:14:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:14:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:14:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:14:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:14:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:14:54 [DEBUG   ] Finished updating board flags in 1.353 seconds
2019-01-16 09:15:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:15:14 [DEBUG   ] Got command BAM from MCS: ref #1184706
2019-01-16 09:15:14 [INFO    ] Finished processing BAM request
2019-01-16 09:15:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:15:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184706   8 58499 33314033 A  ERROR'
2019-01-16 09:15:14 [DEBUG   ] Got command BAM from MCS: ref #1184705
2019-01-16 09:15:14 [INFO    ] Finished processing BAM request
2019-01-16 09:15:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:15:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184705   8 58499 33314037 A  ERROR'
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 09:15:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 09:15:14 [DEBUG   ] spawn_process: at 2019-01-16 09:15:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 09:15:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:15:36 [DEBUG   ] Got command BAM from MCS: ref #1184708
2019-01-16 09:15:36 [INFO    ] Finished processing BAM request
2019-01-16 09:15:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:15:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184708   8 58499 33336033 A  ERROR'
2019-01-16 09:15:36 [DEBUG   ] Got command BAM from MCS: ref #1184707
2019-01-16 09:15:36 [INFO    ] Finished processing BAM request
2019-01-16 09:15:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:15:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184707   8 58499 33336037 A  ERROR'
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 09:15:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 09:15:36 [DEBUG   ] spawn_process: at 2019-01-16 09:15:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 09:15:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:15:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:15:54 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 09:15:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:15:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:15:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:15:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:15:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:15:54 [DEBUG   ] Finished updating board flags in 1.200 seconds
2019-01-16 09:15:58 [DEBUG   ] Got command BAM from MCS: ref #1184709
2019-01-16 09:15:58 [INFO    ] Finished processing BAM request
2019-01-16 09:15:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184709   8 58499 33358025 A  ERROR'
2019-01-16 09:15:58 [DEBUG   ] Got command BAM from MCS: ref #1184710
2019-01-16 09:15:58 [INFO    ] Finished processing BAM request
2019-01-16 09:15:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184710   8 58499 33358029 A  ERROR'
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 09:15:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 09:15:58 [DEBUG   ] spawn_process: at 2019-01-16 09:15:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 09:16:05 [DEBUG   ] Got command RPT from MCS: ref #1184711
2019-01-16 09:16:05 [DEBUG   ] summary = ERROR
2019-01-16 09:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184711  13 58499 33365277 A  ERRORERROR'
2019-01-16 09:16:05 [DEBUG   ] Got command RPT from MCS: ref #1184712
2019-01-16 09:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184712  77 58499 33365278 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:16:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:16:20 [DEBUG   ] Got command BAM from MCS: ref #1184729
2019-01-16 09:16:20 [INFO    ] Finished processing BAM request
2019-01-16 09:16:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:16:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184729   8 58499 33380033 A  ERROR'
2019-01-16 09:16:20 [DEBUG   ] Got command BAM from MCS: ref #1184728
2019-01-16 09:16:20 [INFO    ] Finished processing BAM request
2019-01-16 09:16:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:16:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184728   8 58499 33380041 A  ERROR'
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 09:16:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 09:16:20 [DEBUG   ] spawn_process: at 2019-01-16 09:16:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 09:16:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:16:40 [DEBUG   ] Got command RPT from MCS: ref #1184732
2019-01-16 09:16:40 [DEBUG   ] summary = ERROR
2019-01-16 09:16:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184732  13 58499 33400029 A  ERRORERROR'
2019-01-16 09:16:40 [DEBUG   ] Got command RPT from MCS: ref #1184733
2019-01-16 09:16:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:16:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184733  77 58499 33400221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:16:40 [DEBUG   ] Got command RPT from MCS: ref #1184734
2019-01-16 09:16:40 [DEBUG   ] summary = ERROR
2019-01-16 09:16:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184734  13 58499 33400425 A  ERRORERROR'
2019-01-16 09:16:40 [DEBUG   ] Got command RPT from MCS: ref #1184736
2019-01-16 09:16:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:16:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184736  77 58499 33400629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:16:40 [DEBUG   ] Got command RPT from MCS: ref #1184738
2019-01-16 09:16:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 09:16:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184738  12 58499 33400833 A  ERRORB¢ff'
2019-01-16 09:16:42 [DEBUG   ] Got command BAM from MCS: ref #1184739
2019-01-16 09:16:42 [INFO    ] Finished processing BAM request
2019-01-16 09:16:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:16:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184739   8 58499 33402029 A  ERROR'
2019-01-16 09:16:42 [DEBUG   ] Got command BAM from MCS: ref #1184740
2019-01-16 09:16:42 [INFO    ] Finished processing BAM request
2019-01-16 09:16:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:16:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184740   8 58499 33402033 A  ERROR'
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:16:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:16:42 [DEBUG   ] spawn_process: at 2019-01-16 09:16:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:16:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 09:16:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 09:16:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-16 09:16:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:16:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 09:16:54 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 09:16:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:16:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:16:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:16:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:16:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:16:54 [DEBUG   ] Finished updating board flags in 1.208 seconds
2019-01-16 09:17:04 [DEBUG   ] Got command BAM from MCS: ref #1184745
2019-01-16 09:17:04 [INFO    ] Finished processing BAM request
2019-01-16 09:17:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:17:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184745   8 58499 33424025 A  ERROR'
2019-01-16 09:17:04 [DEBUG   ] Got command BAM from MCS: ref #1184744
2019-01-16 09:17:04 [INFO    ] Finished processing BAM request
2019-01-16 09:17:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:17:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184744   8 58499 33424029 A  ERROR'
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 09:17:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 09:17:04 [DEBUG   ] spawn_process: at 2019-01-16 09:17:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 09:17:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 09:17:26 [DEBUG   ] Got command BAM from MCS: ref #1184747
2019-01-16 09:17:26 [INFO    ] Finished processing BAM request
2019-01-16 09:17:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:17:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184747   8 58499 33446025 A  ERROR'
2019-01-16 09:17:26 [DEBUG   ] Got command BAM from MCS: ref #1184746
2019-01-16 09:17:26 [INFO    ] Finished processing BAM request
2019-01-16 09:17:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:17:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184746   8 58499 33446029 A  ERROR'
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:17:26 [DEBUG   ] spawn_process: at 2019-01-16 09:17:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:17:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 09:17:48 [DEBUG   ] Got command BAM from MCS: ref #1184751
2019-01-16 09:17:48 [INFO    ] Finished processing BAM request
2019-01-16 09:17:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:17:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184751   8 58499 33468033 A  ERROR'
2019-01-16 09:17:48 [DEBUG   ] Got command BAM from MCS: ref #1184752
2019-01-16 09:17:48 [INFO    ] Finished processing BAM request
2019-01-16 09:17:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:17:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184752   8 58499 33468037 A  ERROR'
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 09:17:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 09:17:48 [DEBUG   ] spawn_process: at 2019-01-16 09:17:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 09:17:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 09:17:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:17:54 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 09:17:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 09:17:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:17:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:17:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:17:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:17:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:17:54 [DEBUG   ] Finished updating board flags in 1.195 seconds
2019-01-16 09:18:10 [DEBUG   ] Got command BAM from MCS: ref #1184755
2019-01-16 09:18:10 [INFO    ] Finished processing BAM request
2019-01-16 09:18:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:18:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184755   8 58499 33490025 A  ERROR'
2019-01-16 09:18:10 [DEBUG   ] Got command BAM from MCS: ref #1184754
2019-01-16 09:18:10 [INFO    ] Finished processing BAM request
2019-01-16 09:18:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:18:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184754   8 58499 33490029 A  ERROR'
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 09:18:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 09:18:10 [DEBUG   ] spawn_process: at 2019-01-16 09:18:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 09:18:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 09:18:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:18:32 [DEBUG   ] Got command BAM from MCS: ref #1184757
2019-01-16 09:18:32 [INFO    ] Finished processing BAM request
2019-01-16 09:18:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:18:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184757   8 58499 33512029 A  ERROR'
2019-01-16 09:18:32 [DEBUG   ] Got command BAM from MCS: ref #1184756
2019-01-16 09:18:32 [INFO    ] Finished processing BAM request
2019-01-16 09:18:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:18:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184756   8 58499 33512033 A  ERROR'
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 09:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 09:18:32 [DEBUG   ] spawn_process: at 2019-01-16 09:18:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 09:18:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:18:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 09:18:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-16 09:18:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:18:54 [DEBUG   ] Got command BAM from MCS: ref #1184758
2019-01-16 09:18:54 [INFO    ] Finished processing BAM request
2019-01-16 09:18:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:18:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184758   8 58499 33534025 A  ERROR'
2019-01-16 09:18:54 [DEBUG   ] Got command BAM from MCS: ref #1184759
2019-01-16 09:18:54 [INFO    ] Finished processing BAM request
2019-01-16 09:18:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:18:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184759   8 58499 33534029 A  ERROR'
2019-01-16 09:18:54 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 09:18:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 09:18:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:18:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:18:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:18:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:18:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:18:54 [DEBUG   ] Finished updating board flags in 1.010 seconds
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:18:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:18:54 [DEBUG   ] spawn_process: at 2019-01-16 09:18:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:19:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:19:16 [DEBUG   ] Got command BAM from MCS: ref #1184760
2019-01-16 09:19:16 [INFO    ] Finished processing BAM request
2019-01-16 09:19:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:19:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184760   8 58499 33556033 A  ERROR'
2019-01-16 09:19:16 [DEBUG   ] Got command BAM from MCS: ref #1184761
2019-01-16 09:19:16 [INFO    ] Finished processing BAM request
2019-01-16 09:19:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:19:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184761   8 58499 33556037 A  ERROR'
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 09:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 09:19:16 [DEBUG   ] spawn_process: at 2019-01-16 09:19:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 09:19:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:19:38 [DEBUG   ] Got command BAM from MCS: ref #1184762
2019-01-16 09:19:38 [INFO    ] Finished processing BAM request
2019-01-16 09:19:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:19:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184762   8 58499 33578029 A  ERROR'
2019-01-16 09:19:38 [DEBUG   ] Got command BAM from MCS: ref #1184763
2019-01-16 09:19:38 [INFO    ] Finished processing BAM request
2019-01-16 09:19:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:19:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184763   8 58499 33578033 A  ERROR'
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:19:38 [DEBUG   ] spawn_process: at 2019-01-16 09:19:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:19:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:19:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-16 09:19:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2019-01-16 09:19:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:19:54 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 09:19:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 09:19:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:19:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:19:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:19:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:19:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:19:54 [DEBUG   ] Finished updating board flags in 1.072 seconds
2019-01-16 09:20:00 [DEBUG   ] Got command BAM from MCS: ref #1184764
2019-01-16 09:20:00 [INFO    ] Finished processing BAM request
2019-01-16 09:20:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:20:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184764   8 58499 33600025 A  ERROR'
2019-01-16 09:20:00 [DEBUG   ] Got command BAM from MCS: ref #1184765
2019-01-16 09:20:00 [INFO    ] Finished processing BAM request
2019-01-16 09:20:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:20:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184765   8 58499 33600029 A  ERROR'
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 09:20:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 09:20:00 [DEBUG   ] spawn_process: at 2019-01-16 09:20:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 09:20:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-16 09:20:22 [DEBUG   ] Got command BAM from MCS: ref #1184766
2019-01-16 09:20:22 [INFO    ] Finished processing BAM request
2019-01-16 09:20:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:20:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184766   8 58499 33622029 A  ERROR'
2019-01-16 09:20:22 [DEBUG   ] Got command BAM from MCS: ref #1184767
2019-01-16 09:20:22 [INFO    ] Finished processing BAM request
2019-01-16 09:20:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:20:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184767   8 58499 33622033 A  ERROR'
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 09:20:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 09:20:22 [DEBUG   ] spawn_process: at 2019-01-16 09:20:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 09:20:31 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-16 09:20:44 [DEBUG   ] Got command BAM from MCS: ref #1184769
2019-01-16 09:20:44 [INFO    ] Finished processing BAM request
2019-01-16 09:20:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:20:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184769   8 58499 33644025 A  ERROR'
2019-01-16 09:20:44 [DEBUG   ] Got command BAM from MCS: ref #1184768
2019-01-16 09:20:44 [INFO    ] Finished processing BAM request
2019-01-16 09:20:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:20:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184768   8 58499 33644029 A  ERROR'
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:20:44 [DEBUG   ] spawn_process: at 2019-01-16 09:20:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:20:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 09:20:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 09:20:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:20:55 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 09:20:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 09:20:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:20:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:20:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:20:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:20:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:20:55 [DEBUG   ] Finished updating board flags in 2.003 seconds
2019-01-16 09:21:05 [DEBUG   ] Got command RPT from MCS: ref #1184776
2019-01-16 09:21:05 [DEBUG   ] summary = ERROR
2019-01-16 09:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184776  13 58499 33665281 A  ERRORERROR'
2019-01-16 09:21:05 [DEBUG   ] Got command RPT from MCS: ref #1184777
2019-01-16 09:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184777  77 58499 33665282 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:21:06 [DEBUG   ] Got command BAM from MCS: ref #1184774
2019-01-16 09:21:06 [INFO    ] Finished processing BAM request
2019-01-16 09:21:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184774   8 58499 33666029 A  ERROR'
2019-01-16 09:21:06 [DEBUG   ] Got command BAM from MCS: ref #1184775
2019-01-16 09:21:06 [INFO    ] Finished processing BAM request
2019-01-16 09:21:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184775   8 58499 33666033 A  ERROR'
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 09:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 09:21:06 [DEBUG   ] spawn_process: at 2019-01-16 09:21:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 09:21:11 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-16 09:21:28 [DEBUG   ] Got command BAM from MCS: ref #1184793
2019-01-16 09:21:28 [INFO    ] Finished processing BAM request
2019-01-16 09:21:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:21:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184793   8 58499 33688025 A  ERROR'
2019-01-16 09:21:28 [DEBUG   ] Got command BAM from MCS: ref #1184794
2019-01-16 09:21:28 [INFO    ] Finished processing BAM request
2019-01-16 09:21:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:21:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184794   8 58499 33688029 A  ERROR'
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 09:21:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 09:21:28 [DEBUG   ] spawn_process: at 2019-01-16 09:21:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 09:21:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:21:40 [DEBUG   ] Got command RPT from MCS: ref #1184795
2019-01-16 09:21:40 [DEBUG   ] summary = ERROR
2019-01-16 09:21:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184795  13 58499 33700113 A  ERRORERROR'
2019-01-16 09:21:40 [DEBUG   ] Got command RPT from MCS: ref #1184796
2019-01-16 09:21:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:21:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184796  77 58499 33700317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:21:40 [DEBUG   ] Got command RPT from MCS: ref #1184797
2019-01-16 09:21:40 [DEBUG   ] summary = ERROR
2019-01-16 09:21:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184797  13 58499 33700509 A  ERRORERROR'
2019-01-16 09:21:40 [DEBUG   ] Got command RPT from MCS: ref #1184798
2019-01-16 09:21:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:21:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184798  77 58499 33700713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:21:40 [DEBUG   ] Got command RPT from MCS: ref #1184799
2019-01-16 09:21:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 09:21:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184799  12 58499 33700917 A  ERRORB£ff'
2019-01-16 09:21:50 [DEBUG   ] Got command BAM from MCS: ref #1184800
2019-01-16 09:21:50 [INFO    ] Finished processing BAM request
2019-01-16 09:21:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:21:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184800   8 58499 33710033 A  ERROR'
2019-01-16 09:21:50 [DEBUG   ] Got command BAM from MCS: ref #1184801
2019-01-16 09:21:50 [INFO    ] Finished processing BAM request
2019-01-16 09:21:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:21:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184801   8 58499 33710037 A  ERROR'
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 09:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 09:21:50 [DEBUG   ] spawn_process: at 2019-01-16 09:21:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 09:21:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:21:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 09:21:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 09:21:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:21:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 09:21:54 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 09:21:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:21:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:21:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:21:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:21:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:21:54 [DEBUG   ] Finished updating board flags in 1.365 seconds
2019-01-16 09:22:12 [DEBUG   ] Got command BAM from MCS: ref #1184802
2019-01-16 09:22:12 [INFO    ] Finished processing BAM request
2019-01-16 09:22:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:22:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184802   8 58499 33732033 A  ERROR'
2019-01-16 09:22:12 [DEBUG   ] Got command BAM from MCS: ref #1184803
2019-01-16 09:22:12 [INFO    ] Finished processing BAM request
2019-01-16 09:22:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:22:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184803   8 58499 33732037 A  ERROR'
2019-01-16 09:22:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:22:12 [DEBUG   ] spawn_process: at 2019-01-16 09:22:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:22:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 09:22:34 [DEBUG   ] Got command BAM from MCS: ref #1184805
2019-01-16 09:22:34 [INFO    ] Finished processing BAM request
2019-01-16 09:22:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:22:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184805   8 58499 33754025 A  ERROR'
2019-01-16 09:22:34 [DEBUG   ] Got command BAM from MCS: ref #1184804
2019-01-16 09:22:34 [INFO    ] Finished processing BAM request
2019-01-16 09:22:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:22:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184804   8 58499 33754029 A  ERROR'
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 09:22:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 09:22:34 [DEBUG   ] spawn_process: at 2019-01-16 09:22:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 09:22:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:22:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 09:22:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:22:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-16 09:22:54 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 09:22:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 09:22:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:22:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:22:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:22:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:22:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:22:54 [DEBUG   ] Finished updating board flags in 1.216 seconds
2019-01-16 09:22:56 [DEBUG   ] Got command BAM from MCS: ref #1184806
2019-01-16 09:22:56 [INFO    ] Finished processing BAM request
2019-01-16 09:22:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:22:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184806   8 58499 33776029 A  ERROR'
2019-01-16 09:22:56 [DEBUG   ] Got command BAM from MCS: ref #1184807
2019-01-16 09:22:56 [INFO    ] Finished processing BAM request
2019-01-16 09:22:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:22:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184807   8 58499 33776033 A  ERROR'
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 09:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 09:22:56 [DEBUG   ] spawn_process: at 2019-01-16 09:22:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 09:23:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:23:18 [DEBUG   ] Got command BAM from MCS: ref #1184809
2019-01-16 09:23:18 [INFO    ] Finished processing BAM request
2019-01-16 09:23:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:23:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184809   8 58499 33798033 A  ERROR'
2019-01-16 09:23:18 [DEBUG   ] Got command BAM from MCS: ref #1184808
2019-01-16 09:23:18 [INFO    ] Finished processing BAM request
2019-01-16 09:23:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:23:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184808   8 58499 33798037 A  ERROR'
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 09:23:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 09:23:18 [DEBUG   ] spawn_process: at 2019-01-16 09:23:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 09:23:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:23:40 [DEBUG   ] Got command BAM from MCS: ref #1184811
2019-01-16 09:23:40 [INFO    ] Finished processing BAM request
2019-01-16 09:23:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:23:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184811   8 58499 33820029 A  ERROR'
2019-01-16 09:23:40 [DEBUG   ] Got command BAM from MCS: ref #1184810
2019-01-16 09:23:40 [INFO    ] Finished processing BAM request
2019-01-16 09:23:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:23:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184810   8 58499 33820033 A  ERROR'
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:23:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:23:40 [DEBUG   ] spawn_process: at 2019-01-16 09:23:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:23:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:23:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 09:23:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 09:23:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-01-16 09:23:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:23:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 09:23:54 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 09:23:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:23:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:23:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:23:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:23:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:23:54 [DEBUG   ] Finished updating board flags in 1.193 seconds
2019-01-16 09:24:02 [DEBUG   ] Got command BAM from MCS: ref #1184817
2019-01-16 09:24:02 [INFO    ] Finished processing BAM request
2019-01-16 09:24:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:24:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184817   8 58499 33842029 A  ERROR'
2019-01-16 09:24:02 [DEBUG   ] Got command BAM from MCS: ref #1184816
2019-01-16 09:24:02 [INFO    ] Finished processing BAM request
2019-01-16 09:24:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:24:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184816   8 58499 33842033 A  ERROR'
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 09:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 09:24:02 [DEBUG   ] spawn_process: at 2019-01-16 09:24:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 09:24:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:24:24 [DEBUG   ] Got command BAM from MCS: ref #1184818
2019-01-16 09:24:24 [INFO    ] Finished processing BAM request
2019-01-16 09:24:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:24:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184818   8 58499 33864029 A  ERROR'
2019-01-16 09:24:24 [DEBUG   ] Got command BAM from MCS: ref #1184819
2019-01-16 09:24:24 [INFO    ] Finished processing BAM request
2019-01-16 09:24:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:24:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184819   8 58499 33864033 A  ERROR'
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:24:24 [DEBUG   ] spawn_process: at 2019-01-16 09:24:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:24:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:24:46 [DEBUG   ] Got command BAM from MCS: ref #1184821
2019-01-16 09:24:46 [INFO    ] Finished processing BAM request
2019-01-16 09:24:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:24:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184821   8 58499 33886029 A  ERROR'
2019-01-16 09:24:46 [DEBUG   ] Got command BAM from MCS: ref #1184820
2019-01-16 09:24:46 [INFO    ] Finished processing BAM request
2019-01-16 09:24:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:24:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184820   8 58499 33886033 A  ERROR'
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 09:24:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 09:24:46 [DEBUG   ] spawn_process: at 2019-01-16 09:24:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 09:24:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:24:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 09:24:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:24:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 09:24:54 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 09:24:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:24:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:24:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:24:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:24:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:24:54 [DEBUG   ] Finished updating board flags in 1.024 seconds
2019-01-16 09:25:08 [DEBUG   ] Got command BAM from MCS: ref #1184823
2019-01-16 09:25:08 [INFO    ] Finished processing BAM request
2019-01-16 09:25:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:25:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184823   8 58499 33908033 A  ERROR'
2019-01-16 09:25:08 [DEBUG   ] Got command BAM from MCS: ref #1184822
2019-01-16 09:25:08 [INFO    ] Finished processing BAM request
2019-01-16 09:25:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:25:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184822   8 58499 33908041 A  ERROR'
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 09:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 09:25:08 [DEBUG   ] spawn_process: at 2019-01-16 09:25:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 09:25:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:25:30 [DEBUG   ] Got command BAM from MCS: ref #1184824
2019-01-16 09:25:30 [INFO    ] Finished processing BAM request
2019-01-16 09:25:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:25:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184824   8 58499 33930033 A  ERROR'
2019-01-16 09:25:30 [DEBUG   ] Got command BAM from MCS: ref #1184825
2019-01-16 09:25:30 [INFO    ] Finished processing BAM request
2019-01-16 09:25:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:25:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184825   8 58499 33930037 A  ERROR'
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 09:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 09:25:30 [DEBUG   ] spawn_process: at 2019-01-16 09:25:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 09:25:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:25:52 [DEBUG   ] Got command BAM from MCS: ref #1184826
2019-01-16 09:25:52 [INFO    ] Finished processing BAM request
2019-01-16 09:25:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:25:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184826   8 58499 33952033 A  ERROR'
2019-01-16 09:25:52 [DEBUG   ] Got command BAM from MCS: ref #1184827
2019-01-16 09:25:52 [INFO    ] Finished processing BAM request
2019-01-16 09:25:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:25:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184827   8 58499 33952037 A  ERROR'
2019-01-16 09:25:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 09:25:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 09:25:52 [DEBUG   ] spawn_process: at 2019-01-16 09:25:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 09:25:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:25:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 09:25:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 09:25:54 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 09:25:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:25:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:25:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:25:54 [WARNING ] (13, 1, 'bot')
2019-01-16 09:25:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:25:54 [DEBUG   ] Finished updating board flags in 0.972 seconds
2019-01-16 09:26:05 [DEBUG   ] Got command RPT from MCS: ref #1184828
2019-01-16 09:26:05 [DEBUG   ] summary = ERROR
2019-01-16 09:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184828  13 58499 33965285 A  ERRORERROR'
2019-01-16 09:26:05 [DEBUG   ] Got command RPT from MCS: ref #1184829
2019-01-16 09:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184829  77 58499 33965286 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:26:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:26:14 [DEBUG   ] Got command BAM from MCS: ref #1184845
2019-01-16 09:26:14 [INFO    ] Finished processing BAM request
2019-01-16 09:26:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:26:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184845   8 58499 33974025 A  ERROR'
2019-01-16 09:26:14 [DEBUG   ] Got command BAM from MCS: ref #1184846
2019-01-16 09:26:14 [INFO    ] Finished processing BAM request
2019-01-16 09:26:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:26:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184846   8 58499 33974029 A  ERROR'
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 09:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 09:26:14 [DEBUG   ] spawn_process: at 2019-01-16 09:26:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 09:26:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:26:36 [DEBUG   ] Got command BAM from MCS: ref #1184849
2019-01-16 09:26:36 [INFO    ] Finished processing BAM request
2019-01-16 09:26:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:26:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184849   8 58499 33996029 A  ERROR'
2019-01-16 09:26:36 [DEBUG   ] Got command BAM from MCS: ref #1184850
2019-01-16 09:26:36 [INFO    ] Finished processing BAM request
2019-01-16 09:26:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:26:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184850   8 58499 33996033 A  ERROR'
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 09:26:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 09:26:36 [DEBUG   ] spawn_process: at 2019-01-16 09:26:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 09:26:40 [DEBUG   ] Got command RPT from MCS: ref #1184851
2019-01-16 09:26:40 [DEBUG   ] summary = ERROR
2019-01-16 09:26:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184851  13 58499 34000197 A  ERRORERROR'
2019-01-16 09:26:40 [DEBUG   ] Got command RPT from MCS: ref #1184852
2019-01-16 09:26:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:26:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184852  77 58499 34000401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:26:40 [DEBUG   ] Got command RPT from MCS: ref #1184853
2019-01-16 09:26:40 [DEBUG   ] summary = ERROR
2019-01-16 09:26:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184853  13 58499 34000593 A  ERRORERROR'
2019-01-16 09:26:40 [DEBUG   ] Got command RPT from MCS: ref #1184855
2019-01-16 09:26:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:26:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184855  77 58499 34000797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:26:41 [DEBUG   ] Got command RPT from MCS: ref #1184856
2019-01-16 09:26:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 09:26:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184856  12 58499 34001001 A  ERRORB¢ff'
2019-01-16 09:26:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:26:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:26:55 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 09:26:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 09:26:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:26:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:26:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:26:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:26:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:26:55 [DEBUG   ] Finished updating board flags in 1.364 seconds
2019-01-16 09:26:58 [DEBUG   ] Got command BAM from MCS: ref #1184865
2019-01-16 09:26:58 [INFO    ] Finished processing BAM request
2019-01-16 09:26:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:26:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184865   8 58499 34018029 A  ERROR'
2019-01-16 09:26:58 [DEBUG   ] Got command BAM from MCS: ref #1184866
2019-01-16 09:26:58 [INFO    ] Finished processing BAM request
2019-01-16 09:26:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:26:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184866   8 58499 34018033 A  ERROR'
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:26:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:26:58 [DEBUG   ] spawn_process: at 2019-01-16 09:26:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:27:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:27:20 [DEBUG   ] Got command BAM from MCS: ref #1184867
2019-01-16 09:27:20 [INFO    ] Finished processing BAM request
2019-01-16 09:27:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:27:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184867   8 58499 34040033 A  ERROR'
2019-01-16 09:27:20 [DEBUG   ] Got command BAM from MCS: ref #1184868
2019-01-16 09:27:20 [INFO    ] Finished processing BAM request
2019-01-16 09:27:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:27:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184868   8 58499 34040037 A  ERROR'
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 09:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 09:27:20 [DEBUG   ] spawn_process: at 2019-01-16 09:27:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 09:27:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:27:42 [DEBUG   ] Got command BAM from MCS: ref #1184869
2019-01-16 09:27:42 [INFO    ] Finished processing BAM request
2019-01-16 09:27:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:27:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184869   8 58499 34062033 A  ERROR'
2019-01-16 09:27:42 [DEBUG   ] Got command BAM from MCS: ref #1184870
2019-01-16 09:27:42 [INFO    ] Finished processing BAM request
2019-01-16 09:27:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:27:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184870   8 58499 34062037 A  ERROR'
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:27:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:27:42 [DEBUG   ] spawn_process: at 2019-01-16 09:27:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:27:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:27:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-16 09:27:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:27:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-16 09:27:55 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 09:27:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:27:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:27:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:27:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:27:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:27:55 [DEBUG   ] Finished updating board flags in 1.218 seconds
2019-01-16 09:28:04 [DEBUG   ] Got command BAM from MCS: ref #1184872
2019-01-16 09:28:04 [INFO    ] Finished processing BAM request
2019-01-16 09:28:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:28:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184872   8 58499 34084025 A  ERROR'
2019-01-16 09:28:04 [DEBUG   ] Got command BAM from MCS: ref #1184871
2019-01-16 09:28:04 [INFO    ] Finished processing BAM request
2019-01-16 09:28:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:28:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184871   8 58499 34084029 A  ERROR'
2019-01-16 09:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 09:28:04 [DEBUG   ] spawn_process: at 2019-01-16 09:28:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 09:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 09:28:04 [DEBUG   ] spawn_process: at 2019-01-16 09:28:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 09:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 09:28:04 [DEBUG   ] spawn_process: at 2019-01-16 09:28:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 09:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 09:28:04 [DEBUG   ] spawn_process: at 2019-01-16 09:28:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 09:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 09:28:04 [DEBUG   ] spawn_process: at 2019-01-16 09:28:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 09:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 09:28:04 [DEBUG   ] spawn_process: at 2019-01-16 09:28:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 09:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 09:28:04 [DEBUG   ] spawn_process: at 2019-01-16 09:28:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 09:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 09:28:04 [DEBUG   ] spawn_process: at 2019-01-16 09:28:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 09:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 09:28:04 [DEBUG   ] spawn_process: at 2019-01-16 09:28:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 09:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 09:28:04 [DEBUG   ] spawn_process: at 2019-01-16 09:28:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 09:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 09:28:04 [DEBUG   ] spawn_process: at 2019-01-16 09:28:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 09:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 09:28:04 [DEBUG   ] spawn_process: at 2019-01-16 09:28:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 09:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 09:28:04 [DEBUG   ] spawn_process: at 2019-01-16 09:28:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 09:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 09:28:04 [DEBUG   ] spawn_process: at 2019-01-16 09:28:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 09:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 09:28:04 [DEBUG   ] spawn_process: at 2019-01-16 09:28:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 09:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 09:28:04 [DEBUG   ] spawn_process: at 2019-01-16 09:28:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 09:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 09:28:04 [DEBUG   ] spawn_process: at 2019-01-16 09:28:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 09:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 09:28:04 [DEBUG   ] spawn_process: at 2019-01-16 09:28:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 09:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 09:28:04 [DEBUG   ] spawn_process: at 2019-01-16 09:28:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 09:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 09:28:04 [DEBUG   ] spawn_process: at 2019-01-16 09:28:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 09:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 09:28:04 [DEBUG   ] spawn_process: at 2019-01-16 09:28:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 09:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 09:28:04 [DEBUG   ] spawn_process: at 2019-01-16 09:28:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 09:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 09:28:04 [DEBUG   ] spawn_process: at 2019-01-16 09:28:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 09:28:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 09:28:04 [DEBUG   ] spawn_process: at 2019-01-16 09:28:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 09:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 09:28:05 [DEBUG   ] spawn_process: at 2019-01-16 09:28:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 09:28:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 09:28:05 [DEBUG   ] spawn_process: at 2019-01-16 09:28:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 09:28:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 09:28:26 [DEBUG   ] Got command BAM from MCS: ref #1184874
2019-01-16 09:28:26 [INFO    ] Finished processing BAM request
2019-01-16 09:28:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184874   8 58499 34106029 A  ERROR'
2019-01-16 09:28:26 [DEBUG   ] Got command BAM from MCS: ref #1184873
2019-01-16 09:28:26 [INFO    ] Finished processing BAM request
2019-01-16 09:28:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184873   8 58499 34106033 A  ERROR'
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:28:26 [DEBUG   ] spawn_process: at 2019-01-16 09:28:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:28:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:28:48 [DEBUG   ] Got command BAM from MCS: ref #1184875
2019-01-16 09:28:48 [INFO    ] Finished processing BAM request
2019-01-16 09:28:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:28:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184875   8 58499 34128033 A  ERROR'
2019-01-16 09:28:48 [DEBUG   ] Got command BAM from MCS: ref #1184876
2019-01-16 09:28:48 [INFO    ] Finished processing BAM request
2019-01-16 09:28:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:28:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184876   8 58499 34128037 A  ERROR'
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 09:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 09:28:48 [DEBUG   ] spawn_process: at 2019-01-16 09:28:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 09:28:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:28:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-16 09:28:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:28:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 09:28:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-01-16 09:28:55 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 09:28:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:28:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:28:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:28:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:28:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:28:55 [DEBUG   ] Finished updating board flags in 1.187 seconds
2019-01-16 09:29:10 [DEBUG   ] Got command BAM from MCS: ref #1184878
2019-01-16 09:29:10 [INFO    ] Finished processing BAM request
2019-01-16 09:29:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:29:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184878   8 58499 34150033 A  ERROR'
2019-01-16 09:29:10 [DEBUG   ] Got command BAM from MCS: ref #1184877
2019-01-16 09:29:10 [INFO    ] Finished processing BAM request
2019-01-16 09:29:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:29:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184877   8 58499 34150037 A  ERROR'
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:29:10 [DEBUG   ] spawn_process: at 2019-01-16 09:29:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:29:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:29:32 [DEBUG   ] Got command BAM from MCS: ref #1184879
2019-01-16 09:29:32 [INFO    ] Finished processing BAM request
2019-01-16 09:29:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:29:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184879   8 58499 34172029 A  ERROR'
2019-01-16 09:29:32 [DEBUG   ] Got command BAM from MCS: ref #1184880
2019-01-16 09:29:32 [INFO    ] Finished processing BAM request
2019-01-16 09:29:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:29:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184880   8 58499 34172033 A  ERROR'
2019-01-16 09:29:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 09:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 09:29:32 [DEBUG   ] spawn_process: at 2019-01-16 09:29:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 09:29:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:29:54 [DEBUG   ] Got command BAM from MCS: ref #1184886
2019-01-16 09:29:54 [INFO    ] Finished processing BAM request
2019-01-16 09:29:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:29:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184886   8 58499 34194025 A  ERROR'
2019-01-16 09:29:54 [DEBUG   ] Got command BAM from MCS: ref #1184885
2019-01-16 09:29:54 [INFO    ] Finished processing BAM request
2019-01-16 09:29:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:29:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184885   8 58499 34194029 A  ERROR'
2019-01-16 09:29:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 09:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 09:29:54 [DEBUG   ] spawn_process: at 2019-01-16 09:29:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 09:29:55 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 09:29:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:29:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:29:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:29:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:29:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:29:55 [DEBUG   ] Finished updating board flags in 1.005 seconds
2019-01-16 09:30:12 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2019-01-16 09:30:16 [DEBUG   ] Got command BAM from MCS: ref #1184887
2019-01-16 09:30:16 [INFO    ] Finished processing BAM request
2019-01-16 09:30:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:30:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184887   8 58499 34216033 A  ERROR'
2019-01-16 09:30:16 [DEBUG   ] Got command BAM from MCS: ref #1184888
2019-01-16 09:30:16 [INFO    ] Finished processing BAM request
2019-01-16 09:30:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:30:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184888   8 58499 34216037 A  ERROR'
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 09:30:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 09:30:16 [DEBUG   ] spawn_process: at 2019-01-16 09:30:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 09:30:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 09:30:38 [DEBUG   ] Got command BAM from MCS: ref #1184889
2019-01-16 09:30:38 [INFO    ] Finished processing BAM request
2019-01-16 09:30:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:30:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184889   8 58499 34238033 A  ERROR'
2019-01-16 09:30:38 [DEBUG   ] Got command BAM from MCS: ref #1184890
2019-01-16 09:30:38 [INFO    ] Finished processing BAM request
2019-01-16 09:30:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:30:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184890   8 58499 34238037 A  ERROR'
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 09:30:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 09:30:38 [DEBUG   ] spawn_process: at 2019-01-16 09:30:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 09:30:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 09:30:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 09:30:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:30:55 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 09:30:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:30:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:30:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:30:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:30:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:30:55 [DEBUG   ] Finished updating board flags in 1.015 seconds
2019-01-16 09:31:00 [DEBUG   ] Got command BAM from MCS: ref #1184891
2019-01-16 09:31:00 [INFO    ] Finished processing BAM request
2019-01-16 09:31:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:31:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184891   8 58499 34260025 A  ERROR'
2019-01-16 09:31:00 [DEBUG   ] Got command BAM from MCS: ref #1184892
2019-01-16 09:31:00 [INFO    ] Finished processing BAM request
2019-01-16 09:31:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:31:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184892   8 58499 34260029 A  ERROR'
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 09:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 09:31:00 [DEBUG   ] spawn_process: at 2019-01-16 09:31:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 09:31:05 [DEBUG   ] Got command RPT from MCS: ref #1184893
2019-01-16 09:31:05 [DEBUG   ] summary = ERROR
2019-01-16 09:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184893  13 58499 34265281 A  ERRORERROR'
2019-01-16 09:31:05 [DEBUG   ] Got command RPT from MCS: ref #1184894
2019-01-16 09:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184894  77 58499 34265282 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:31:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 09:31:22 [DEBUG   ] Got command BAM from MCS: ref #1184910
2019-01-16 09:31:22 [INFO    ] Finished processing BAM request
2019-01-16 09:31:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:31:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184910   8 58499 34282029 A  ERROR'
2019-01-16 09:31:22 [DEBUG   ] Got command BAM from MCS: ref #1184911
2019-01-16 09:31:22 [INFO    ] Finished processing BAM request
2019-01-16 09:31:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:31:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184911   8 58499 34282033 A  ERROR'
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 09:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 09:31:22 [DEBUG   ] spawn_process: at 2019-01-16 09:31:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 09:31:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 09:31:40 [DEBUG   ] Got command RPT from MCS: ref #1184912
2019-01-16 09:31:40 [DEBUG   ] summary = ERROR
2019-01-16 09:31:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184912  13 58499 34300285 A  ERRORERROR'
2019-01-16 09:31:40 [DEBUG   ] Got command RPT from MCS: ref #1184913
2019-01-16 09:31:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:31:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184913  77 58499 34300477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:31:40 [DEBUG   ] Got command RPT from MCS: ref #1184914
2019-01-16 09:31:40 [DEBUG   ] summary = ERROR
2019-01-16 09:31:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184914  13 58499 34300681 A  ERRORERROR'
2019-01-16 09:31:40 [DEBUG   ] Got command RPT from MCS: ref #1184915
2019-01-16 09:31:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:31:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184915  77 58499 34300885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:31:41 [DEBUG   ] Got command RPT from MCS: ref #1184916
2019-01-16 09:31:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 09:31:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184916  12 58499 34301089 A  ERRORB£ff'
2019-01-16 09:31:44 [DEBUG   ] Got command BAM from MCS: ref #1184917
2019-01-16 09:31:44 [INFO    ] Finished processing BAM request
2019-01-16 09:31:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:31:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184917   8 58499 34304033 A  ERROR'
2019-01-16 09:31:44 [DEBUG   ] Got command BAM from MCS: ref #1184918
2019-01-16 09:31:44 [INFO    ] Finished processing BAM request
2019-01-16 09:31:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:31:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184918   8 58499 34304037 A  ERROR'
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:31:44 [DEBUG   ] spawn_process: at 2019-01-16 09:31:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:31:52 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-16 09:31:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:31:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-16 09:31:55 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 09:31:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:31:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:31:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:31:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:31:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:31:55 [DEBUG   ] Finished updating board flags in 0.989 seconds
2019-01-16 09:32:06 [DEBUG   ] Got command BAM from MCS: ref #1184919
2019-01-16 09:32:06 [INFO    ] Finished processing BAM request
2019-01-16 09:32:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:32:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184919   8 58499 34326037 A  ERROR'
2019-01-16 09:32:06 [DEBUG   ] Got command BAM from MCS: ref #1184920
2019-01-16 09:32:06 [INFO    ] Finished processing BAM request
2019-01-16 09:32:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:32:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184920   8 58499 34326045 A  ERROR'
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 09:32:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 09:32:06 [DEBUG   ] spawn_process: at 2019-01-16 09:32:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 09:32:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 09:32:28 [DEBUG   ] Got command BAM from MCS: ref #1184921
2019-01-16 09:32:28 [INFO    ] Finished processing BAM request
2019-01-16 09:32:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:32:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184921   8 58499 34348025 A  ERROR'
2019-01-16 09:32:28 [DEBUG   ] Got command BAM from MCS: ref #1184922
2019-01-16 09:32:28 [INFO    ] Finished processing BAM request
2019-01-16 09:32:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:32:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184922   8 58499 34348029 A  ERROR'
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 09:32:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 09:32:28 [DEBUG   ] spawn_process: at 2019-01-16 09:32:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 09:32:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 09:32:50 [DEBUG   ] Got command BAM from MCS: ref #1184927
2019-01-16 09:32:50 [INFO    ] Finished processing BAM request
2019-01-16 09:32:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:32:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184927   8 58499 34370033 A  ERROR'
2019-01-16 09:32:50 [DEBUG   ] Got command BAM from MCS: ref #1184928
2019-01-16 09:32:50 [INFO    ] Finished processing BAM request
2019-01-16 09:32:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:32:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184928   8 58499 34370037 A  ERROR'
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 09:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 09:32:50 [DEBUG   ] spawn_process: at 2019-01-16 09:32:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 09:32:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:32:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:32:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 09:32:55 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 09:32:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:32:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:32:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:32:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:32:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:32:55 [DEBUG   ] Finished updating board flags in 1.273 seconds
2019-01-16 09:33:12 [DEBUG   ] Got command BAM from MCS: ref #1184929
2019-01-16 09:33:12 [INFO    ] Finished processing BAM request
2019-01-16 09:33:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:33:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184929   8 58499 34392025 A  ERROR'
2019-01-16 09:33:12 [DEBUG   ] Got command BAM from MCS: ref #1184930
2019-01-16 09:33:12 [INFO    ] Finished processing BAM request
2019-01-16 09:33:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:33:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184930   8 58499 34392029 A  ERROR'
2019-01-16 09:33:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 09:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 09:33:12 [DEBUG   ] spawn_process: at 2019-01-16 09:33:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 09:33:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:33:34 [DEBUG   ] Got command BAM from MCS: ref #1184932
2019-01-16 09:33:34 [INFO    ] Finished processing BAM request
2019-01-16 09:33:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:33:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184932   8 58499 34414029 A  ERROR'
2019-01-16 09:33:34 [DEBUG   ] Got command BAM from MCS: ref #1184931
2019-01-16 09:33:34 [INFO    ] Finished processing BAM request
2019-01-16 09:33:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:33:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184931   8 58499 34414033 A  ERROR'
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:33:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:33:34 [DEBUG   ] spawn_process: at 2019-01-16 09:33:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:33:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:33:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 09:33:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:33:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 09:33:56 [DEBUG   ] Got command BAM from MCS: ref #1184933
2019-01-16 09:33:56 [INFO    ] Finished processing BAM request
2019-01-16 09:33:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:33:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184933   8 58499 34436041 A  ERROR'
2019-01-16 09:33:56 [DEBUG   ] Got command BAM from MCS: ref #1184934
2019-01-16 09:33:56 [INFO    ] Finished processing BAM request
2019-01-16 09:33:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:33:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184934   8 58499 34436049 A  ERROR'
2019-01-16 09:33:56 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 09:33:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:33:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:33:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:33:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:33:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:33:56 [DEBUG   ] Finished updating board flags in 1.802 seconds
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 09:33:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 09:33:56 [DEBUG   ] spawn_process: at 2019-01-16 09:33:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 09:34:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:34:18 [DEBUG   ] Got command BAM from MCS: ref #1184936
2019-01-16 09:34:18 [INFO    ] Finished processing BAM request
2019-01-16 09:34:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:34:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184936   8 58499 34458033 A  ERROR'
2019-01-16 09:34:18 [DEBUG   ] Got command BAM from MCS: ref #1184935
2019-01-16 09:34:18 [INFO    ] Finished processing BAM request
2019-01-16 09:34:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:34:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184935   8 58499 34458037 A  ERROR'
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 09:34:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 09:34:18 [DEBUG   ] spawn_process: at 2019-01-16 09:34:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 09:34:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:34:40 [DEBUG   ] Got command BAM from MCS: ref #1184937
2019-01-16 09:34:40 [INFO    ] Finished processing BAM request
2019-01-16 09:34:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:34:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184937   8 58499 34480025 A  ERROR'
2019-01-16 09:34:40 [DEBUG   ] Got command BAM from MCS: ref #1184938
2019-01-16 09:34:40 [INFO    ] Finished processing BAM request
2019-01-16 09:34:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:34:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184938   8 58499 34480029 A  ERROR'
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 09:34:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 09:34:40 [DEBUG   ] spawn_process: at 2019-01-16 09:34:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 09:34:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 09:34:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 09:34:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-16 09:34:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:34:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 09:34:56 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 09:34:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:34:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:34:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:34:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:34:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:34:56 [DEBUG   ] Finished updating board flags in 1.738 seconds
2019-01-16 09:35:02 [DEBUG   ] Got command BAM from MCS: ref #1184939
2019-01-16 09:35:02 [INFO    ] Finished processing BAM request
2019-01-16 09:35:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:35:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184939   8 58499 34502029 A  ERROR'
2019-01-16 09:35:02 [DEBUG   ] Got command BAM from MCS: ref #1184940
2019-01-16 09:35:02 [INFO    ] Finished processing BAM request
2019-01-16 09:35:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:35:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184940   8 58499 34502033 A  ERROR'
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 09:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 09:35:02 [DEBUG   ] spawn_process: at 2019-01-16 09:35:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 09:35:12 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-16 09:35:24 [DEBUG   ] Got command BAM from MCS: ref #1184941
2019-01-16 09:35:24 [INFO    ] Finished processing BAM request
2019-01-16 09:35:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:35:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184941   8 58499 34524029 A  ERROR'
2019-01-16 09:35:24 [DEBUG   ] Got command BAM from MCS: ref #1184942
2019-01-16 09:35:24 [INFO    ] Finished processing BAM request
2019-01-16 09:35:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:35:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184942   8 58499 34524033 A  ERROR'
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:35:24 [DEBUG   ] spawn_process: at 2019-01-16 09:35:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:35:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 09:35:46 [DEBUG   ] Got command BAM from MCS: ref #1184944
2019-01-16 09:35:46 [INFO    ] Finished processing BAM request
2019-01-16 09:35:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:35:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184944   8 58499 34546033 A  ERROR'
2019-01-16 09:35:46 [DEBUG   ] Got command BAM from MCS: ref #1184943
2019-01-16 09:35:46 [INFO    ] Finished processing BAM request
2019-01-16 09:35:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:35:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184943   8 58499 34546037 A  ERROR'
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 09:35:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 09:35:46 [DEBUG   ] spawn_process: at 2019-01-16 09:35:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 09:35:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 09:35:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 09:35:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:35:55 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 09:35:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:35:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:35:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:35:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:35:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:35:55 [DEBUG   ] Finished updating board flags in 1.048 seconds
2019-01-16 09:36:05 [DEBUG   ] Got command RPT from MCS: ref #1184949
2019-01-16 09:36:05 [DEBUG   ] summary = ERROR
2019-01-16 09:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184949  13 58499 34565289 A  ERRORERROR'
2019-01-16 09:36:05 [DEBUG   ] Got command RPT from MCS: ref #1184950
2019-01-16 09:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184950  77 58499 34565290 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:36:08 [DEBUG   ] Got command BAM from MCS: ref #1184967
2019-01-16 09:36:08 [INFO    ] Finished processing BAM request
2019-01-16 09:36:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:36:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184967   8 58499 34568029 A  ERROR'
2019-01-16 09:36:08 [DEBUG   ] Got command BAM from MCS: ref #1184966
2019-01-16 09:36:08 [INFO    ] Finished processing BAM request
2019-01-16 09:36:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:36:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184966   8 58499 34568033 A  ERROR'
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 09:36:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 09:36:08 [DEBUG   ] spawn_process: at 2019-01-16 09:36:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 09:36:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 09:36:30 [DEBUG   ] Got command BAM from MCS: ref #1184970
2019-01-16 09:36:30 [INFO    ] Finished processing BAM request
2019-01-16 09:36:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:36:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184970   8 58499 34590033 A  ERROR'
2019-01-16 09:36:30 [DEBUG   ] Got command BAM from MCS: ref #1184971
2019-01-16 09:36:30 [INFO    ] Finished processing BAM request
2019-01-16 09:36:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:36:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184971   8 58499 34590037 A  ERROR'
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 09:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 09:36:30 [DEBUG   ] spawn_process: at 2019-01-16 09:36:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 09:36:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 09:36:40 [DEBUG   ] Got command RPT from MCS: ref #1184972
2019-01-16 09:36:40 [DEBUG   ] summary = ERROR
2019-01-16 09:36:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184972  13 58499 34600369 A  ERRORERROR'
2019-01-16 09:36:40 [DEBUG   ] Got command RPT from MCS: ref #1184973
2019-01-16 09:36:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:36:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184973  77 58499 34600573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:36:40 [DEBUG   ] Got command RPT from MCS: ref #1184974
2019-01-16 09:36:40 [DEBUG   ] summary = ERROR
2019-01-16 09:36:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184974  13 58499 34600765 A  ERRORERROR'
2019-01-16 09:36:40 [DEBUG   ] Got command RPT from MCS: ref #1184976
2019-01-16 09:36:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:36:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184976  77 58499 34600972 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:36:41 [DEBUG   ] Got command RPT from MCS: ref #1184977
2019-01-16 09:36:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 09:36:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184977  12 58499 34601173 A  ERRORB¢ff'
2019-01-16 09:36:52 [DEBUG   ] Got command BAM from MCS: ref #1184982
2019-01-16 09:36:52 [INFO    ] Finished processing BAM request
2019-01-16 09:36:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:36:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184982   8 58499 34612037 A  ERROR'
2019-01-16 09:36:52 [DEBUG   ] Got command BAM from MCS: ref #1184983
2019-01-16 09:36:52 [INFO    ] Finished processing BAM request
2019-01-16 09:36:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:36:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184983   8 58499 34612045 A  ERROR'
2019-01-16 09:36:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 09:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 09:36:52 [DEBUG   ] spawn_process: at 2019-01-16 09:36:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 09:36:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 09:36:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-01-16 09:36:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:36:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 09:36:55 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 09:36:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:36:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:36:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:36:55 [WARNING ] (13, 1, 'bot')
2019-01-16 09:36:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:36:55 [DEBUG   ] Finished updating board flags in 0.992 seconds
2019-01-16 09:37:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 09:37:14 [DEBUG   ] Got command BAM from MCS: ref #1184985
2019-01-16 09:37:14 [INFO    ] Finished processing BAM request
2019-01-16 09:37:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:37:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184985   8 58499 34634025 A  ERROR'
2019-01-16 09:37:14 [DEBUG   ] Got command BAM from MCS: ref #1184984
2019-01-16 09:37:14 [INFO    ] Finished processing BAM request
2019-01-16 09:37:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 09:37:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1184984   8 58499 34634029 A  ERROR'
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:37:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:37:14 [DEBUG   ] spawn_process: at 2019-01-16 09:37:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:37:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 09:37:34 [DEBUG   ] Got command STP from MCS: ref #1184987
2019-01-16 09:37:34 [INFO    ] Finished processing BAM request
2019-01-16 09:37:34 [INFO    ] Shutdown the adder chain on beam #3
2019-01-16 09:37:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP  1184987   8 58499 34654033 A  ERROR'
2019-01-16 09:37:34 [DEBUG   ] Got command STP from MCS: ref #1184986
2019-01-16 09:37:34 [INFO    ] Finished processing BAM request
2019-01-16 09:37:34 [INFO    ] Shutdown the adder chain on beam #2
2019-01-16 09:37:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP  1184986   8 58499 34654037 A  ERROR'
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 09:37:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 09:37:34 [DEBUG   ] spawn_process: at 2019-01-16 09:37:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 09:37:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 09:37:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:37:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:37:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:37:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:37:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:37:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:37:56 [DEBUG   ] Finished updating board flags in 1.361 seconds
2019-01-16 09:38:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 09:38:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 09:38:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 09:38:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 09:38:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:38:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:38:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:38:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:38:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:38:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:38:56 [DEBUG   ] Finished updating board flags in 1.216 seconds
2019-01-16 09:39:12 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-16 09:39:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 09:39:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 09:39:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:39:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:39:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:39:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:39:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:39:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:39:56 [DEBUG   ] Finished updating board flags in 1.192 seconds
2019-01-16 09:40:12 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 09:40:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 09:40:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 09:40:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:40:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-16 09:40:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:40:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:40:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:40:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:40:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:40:56 [DEBUG   ] Finished updating board flags in 1.009 seconds
2019-01-16 09:41:05 [DEBUG   ] Got command RPT from MCS: ref #1184992
2019-01-16 09:41:05 [DEBUG   ] summary = ERROR
2019-01-16 09:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184992  13 58499 34865281 A  ERRORERROR'
2019-01-16 09:41:05 [DEBUG   ] Got command RPT from MCS: ref #1184993
2019-01-16 09:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1184993  77 58499 34865282 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:41:12 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 09:41:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 09:41:40 [DEBUG   ] Got command RPT from MCS: ref #1185009
2019-01-16 09:41:40 [DEBUG   ] summary = ERROR
2019-01-16 09:41:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185009  13 58499 34900469 A  ERRORERROR'
2019-01-16 09:41:40 [DEBUG   ] Got command RPT from MCS: ref #1185010
2019-01-16 09:41:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:41:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185010  77 58499 34900673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:41:40 [DEBUG   ] Got command RPT from MCS: ref #1185011
2019-01-16 09:41:40 [DEBUG   ] summary = ERROR
2019-01-16 09:41:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185011  13 58499 34900865 A  ERRORERROR'
2019-01-16 09:41:41 [DEBUG   ] Got command RPT from MCS: ref #1185012
2019-01-16 09:41:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:41:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185012  77 58499 34901069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:41:41 [DEBUG   ] Got command RPT from MCS: ref #1185013
2019-01-16 09:41:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 09:41:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185013  12 58499 34901273 A  ERRORB›™š'
2019-01-16 09:41:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 09:41:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:41:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:41:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:41:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:41:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:41:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:41:56 [DEBUG   ] Finished updating board flags in 1.065 seconds
2019-01-16 09:42:12 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-16 09:42:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:42:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:42:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-16 09:42:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:42:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-16 09:42:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:42:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:42:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:42:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:42:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:42:57 [DEBUG   ] Finished updating board flags in 1.998 seconds
2019-01-16 09:43:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:43:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 09:43:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:43:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 09:43:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:43:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:43:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:43:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:43:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:43:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:43:56 [DEBUG   ] Finished updating board flags in 1.176 seconds
2019-01-16 09:44:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:44:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:44:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:44:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:44:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:44:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:44:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:44:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:44:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:44:56 [DEBUG   ] Finished updating board flags in 1.033 seconds
2019-01-16 09:45:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:45:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:45:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 09:45:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:45:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:45:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:45:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:45:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:45:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:45:56 [DEBUG   ] Finished updating board flags in 1.012 seconds
2019-01-16 09:46:05 [DEBUG   ] Got command RPT from MCS: ref #1185022
2019-01-16 09:46:05 [DEBUG   ] summary = ERROR
2019-01-16 09:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185022  13 58499 35165289 A  ERRORERROR'
2019-01-16 09:46:05 [DEBUG   ] Got command RPT from MCS: ref #1185023
2019-01-16 09:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185023  77 58499 35165290 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:46:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:46:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:46:40 [DEBUG   ] Got command RPT from MCS: ref #1185041
2019-01-16 09:46:40 [DEBUG   ] summary = ERROR
2019-01-16 09:46:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185041  13 58499 35200549 A  ERRORERROR'
2019-01-16 09:46:40 [DEBUG   ] Got command RPT from MCS: ref #1185042
2019-01-16 09:46:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:46:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185042  77 58499 35200753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:46:40 [DEBUG   ] Got command RPT from MCS: ref #1185043
2019-01-16 09:46:40 [DEBUG   ] summary = ERROR
2019-01-16 09:46:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185043  13 58499 35200957 A  ERRORERROR'
2019-01-16 09:46:41 [DEBUG   ] Got command RPT from MCS: ref #1185045
2019-01-16 09:46:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:46:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185045  77 58499 35201161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:46:41 [DEBUG   ] Got command RPT from MCS: ref #1185046
2019-01-16 09:46:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 09:46:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185046  12 58499 35201353 A  ERRORB™™š'
2019-01-16 09:46:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:46:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:46:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:46:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:46:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:46:56 [WARNING ] (13, 1, 'bot')
2019-01-16 09:46:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:46:56 [DEBUG   ] Finished updating board flags in 0.953 seconds
2019-01-16 09:47:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:47:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:47:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 09:47:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:47:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 09:47:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:47:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:47:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:47:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:47:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:47:57 [DEBUG   ] Finished updating board flags in 1.393 seconds
2019-01-16 09:48:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:48:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:48:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 09:48:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:48:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:48:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:48:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:48:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:48:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:48:57 [DEBUG   ] Finished updating board flags in 1.196 seconds
2019-01-16 09:49:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:49:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:49:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 09:49:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 09:49:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:49:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 09:49:58 [WARNING ] (13, 1, 'bot')
2019-01-16 09:49:58 [WARNING ] (13, 1, 'bot')
2019-01-16 09:49:58 [WARNING ] (13, 1, 'bot')
2019-01-16 09:49:58 [WARNING ] (13, 1, 'bot')
2019-01-16 09:49:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:49:58 [DEBUG   ] Finished updating board flags in 2.013 seconds
2019-01-16 09:50:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 09:50:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:50:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:50:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 09:50:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:50:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:50:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:50:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:50:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:50:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:50:57 [DEBUG   ] Finished updating board flags in 1.428 seconds
2019-01-16 09:51:05 [DEBUG   ] Got command RPT from MCS: ref #1185059
2019-01-16 09:51:05 [DEBUG   ] summary = ERROR
2019-01-16 09:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185059  13 58499 35465293 A  ERRORERROR'
2019-01-16 09:51:05 [DEBUG   ] Got command RPT from MCS: ref #1185060
2019-01-16 09:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185060  77 58499 35465294 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:51:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:51:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:51:40 [DEBUG   ] Got command RPT from MCS: ref #1185076
2019-01-16 09:51:40 [DEBUG   ] summary = ERROR
2019-01-16 09:51:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185076  13 58499 35500637 A  ERRORERROR'
2019-01-16 09:51:40 [DEBUG   ] Got command RPT from MCS: ref #1185077
2019-01-16 09:51:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:51:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185077  77 58499 35500841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:51:41 [DEBUG   ] Got command RPT from MCS: ref #1185078
2019-01-16 09:51:41 [DEBUG   ] summary = ERROR
2019-01-16 09:51:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185078  13 58499 35501045 A  ERRORERROR'
2019-01-16 09:51:41 [DEBUG   ] Got command RPT from MCS: ref #1185079
2019-01-16 09:51:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:51:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185079  77 58499 35501249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:51:41 [DEBUG   ] Got command RPT from MCS: ref #1185080
2019-01-16 09:51:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 09:51:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185080  12 58499 35501441 A  ERRORB˜™š'
2019-01-16 09:51:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:51:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 09:51:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:51:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:51:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:51:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:51:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:51:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:51:57 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-01-16 09:52:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 09:52:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 09:52:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 09:52:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-16 09:52:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:52:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:52:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:52:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:52:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:52:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:52:57 [DEBUG   ] Finished updating board flags in 1.425 seconds
2019-01-16 09:53:13 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-16 09:53:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 09:53:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 09:53:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:53:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:53:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:53:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:53:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:53:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:53:57 [DEBUG   ] Finished updating board flags in 1.350 seconds
2019-01-16 09:54:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 09:54:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 09:54:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 09:54:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:54:58 [WARNING ] (13, 1, 'bot')
2019-01-16 09:54:58 [WARNING ] (13, 1, 'bot')
2019-01-16 09:54:58 [WARNING ] (13, 1, 'bot')
2019-01-16 09:54:58 [WARNING ] (13, 1, 'bot')
2019-01-16 09:54:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:54:58 [DEBUG   ] Finished updating board flags in 1.763 seconds
2019-01-16 09:55:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 09:55:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 09:55:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 09:55:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:55:58 [WARNING ] (13, 1, 'bot')
2019-01-16 09:55:58 [WARNING ] (13, 1, 'bot')
2019-01-16 09:55:58 [WARNING ] (13, 1, 'bot')
2019-01-16 09:55:58 [WARNING ] (13, 1, 'bot')
2019-01-16 09:55:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:55:58 [DEBUG   ] Finished updating board flags in 1.638 seconds
2019-01-16 09:56:05 [DEBUG   ] Got command RPT from MCS: ref #1185085
2019-01-16 09:56:05 [DEBUG   ] summary = ERROR
2019-01-16 09:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185085  13 58499 35765289 A  ERRORERROR'
2019-01-16 09:56:05 [DEBUG   ] Got command RPT from MCS: ref #1185086
2019-01-16 09:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185086  77 58499 35765290 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:56:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 09:56:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 09:56:40 [DEBUG   ] Got command RPT from MCS: ref #1185104
2019-01-16 09:56:40 [DEBUG   ] summary = ERROR
2019-01-16 09:56:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185104  13 58499 35800729 A  ERRORERROR'
2019-01-16 09:56:40 [DEBUG   ] Got command RPT from MCS: ref #1185105
2019-01-16 09:56:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:56:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185105  77 58499 35800921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:56:41 [DEBUG   ] Got command RPT from MCS: ref #1185106
2019-01-16 09:56:41 [DEBUG   ] summary = ERROR
2019-01-16 09:56:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185106  13 58499 35801125 A  ERRORERROR'
2019-01-16 09:56:41 [DEBUG   ] Got command RPT from MCS: ref #1185108
2019-01-16 09:56:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 09:56:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185108  77 58499 35801329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 09:56:41 [DEBUG   ] Got command RPT from MCS: ref #1185109
2019-01-16 09:56:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 09:56:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185109  12 58499 35801533 A  ERRORB˜™š'
2019-01-16 09:56:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 09:56:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:56:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:56:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:56:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:56:57 [WARNING ] (13, 1, 'bot')
2019-01-16 09:56:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:56:57 [DEBUG   ] Finished updating board flags in 0.998 seconds
2019-01-16 09:57:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 09:57:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 09:57:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 09:57:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:57:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 09:57:58 [WARNING ] (13, 1, 'bot')
2019-01-16 09:57:58 [WARNING ] (13, 1, 'bot')
2019-01-16 09:57:58 [WARNING ] (13, 1, 'bot')
2019-01-16 09:57:58 [WARNING ] (13, 1, 'bot')
2019-01-16 09:57:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:57:58 [DEBUG   ] Finished updating board flags in 1.393 seconds
2019-01-16 09:58:13 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-16 09:58:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 09:58:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 09:58:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:58:58 [WARNING ] (13, 1, 'bot')
2019-01-16 09:58:58 [WARNING ] (13, 1, 'bot')
2019-01-16 09:58:58 [WARNING ] (13, 1, 'bot')
2019-01-16 09:58:58 [WARNING ] (13, 1, 'bot')
2019-01-16 09:58:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:58:58 [DEBUG   ] Finished updating board flags in 1.157 seconds
2019-01-16 09:59:13 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-16 09:59:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 09:59:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 09:59:57 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 09:59:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 09:59:58 [WARNING ] (13, 1, 'bot')
2019-01-16 09:59:58 [WARNING ] (13, 1, 'bot')
2019-01-16 09:59:58 [WARNING ] (13, 1, 'bot')
2019-01-16 09:59:58 [WARNING ] (13, 1, 'bot')
2019-01-16 09:59:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 09:59:58 [DEBUG   ] Finished updating board flags in 1.011 seconds
2019-01-16 10:00:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 10:00:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 10:00:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 10:00:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:00:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:00:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:00:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:00:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:00:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:00:58 [DEBUG   ] Finished updating board flags in 1.010 seconds
2019-01-16 10:01:05 [DEBUG   ] Got command RPT from MCS: ref #1185122
2019-01-16 10:01:05 [DEBUG   ] summary = ERROR
2019-01-16 10:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185122  13 58499 36065289 A  ERRORERROR'
2019-01-16 10:01:05 [DEBUG   ] Got command RPT from MCS: ref #1185123
2019-01-16 10:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185123  77 58499 36065290 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:01:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 10:01:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 10:01:40 [DEBUG   ] Got command RPT from MCS: ref #1185139
2019-01-16 10:01:40 [DEBUG   ] summary = ERROR
2019-01-16 10:01:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185139  13 58499 36100809 A  ERRORERROR'
2019-01-16 10:01:41 [DEBUG   ] Got command RPT from MCS: ref #1185140
2019-01-16 10:01:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:01:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185140  77 58499 36101013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:01:41 [DEBUG   ] Got command RPT from MCS: ref #1185141
2019-01-16 10:01:41 [DEBUG   ] summary = ERROR
2019-01-16 10:01:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185141  13 58499 36101217 A  ERRORERROR'
2019-01-16 10:01:41 [DEBUG   ] Got command RPT from MCS: ref #1185142
2019-01-16 10:01:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:01:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185142  77 58499 36101421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:01:41 [DEBUG   ] Got command RPT from MCS: ref #1185143
2019-01-16 10:01:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 10:01:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185143  12 58499 36101613 A  ERRORB˜™š'
2019-01-16 10:01:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-16 10:01:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:01:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:01:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:01:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:01:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:01:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:01:58 [DEBUG   ] Finished updating board flags in 1.026 seconds
2019-01-16 10:02:11 [DEBUG   ] Got command TBW from MCS: ref #1185145
2019-01-16 10:02:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-01-16 10:02:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1185145   8 58499 36131609 A  ERROR'
2019-01-16 10:02:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-01-16 10:02:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-01-16 10:02:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-01-16 10:02:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-01-16 10:02:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-01-16 10:02:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-01-16 10:02:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-01-16 10:02:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-01-16 10:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-01-16 10:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-01-16 10:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-01-16 10:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-01-16 10:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-01-16 10:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-01-16 10:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-01-16 10:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-01-16 10:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-01-16 10:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-01-16 10:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-01-16 10:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-01-16 10:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-01-16 10:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-01-16 10:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-01-16 10:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-01-16 10:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-01-16 10:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-01-16 10:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-01-16 10:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-01-16 10:02:13 [DEBUG   ] spawn_process: at 2019-01-16 10:02:13 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-01-16 10:02:13 [INFO    ] Finished spawning TBW
2019-01-16 10:02:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:02:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:02:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:02:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:02:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:02:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:02:59 [DEBUG   ] Finished updating board flags in 2.140 seconds
2019-01-16 10:03:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:03:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:03:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:03:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:03:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:03:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:03:59 [DEBUG   ] Finished updating board flags in 1.878 seconds
2019-01-16 10:04:01 [INFO    ] __waitForTBW - TBW finished in 107.960 s
2019-01-16 10:04:02 [DEBUG   ] Finished updating ant stats in 0.465 seconds
2019-01-16 10:04:02 [INFO    ] Started antennas statistics background thread
2019-01-16 10:04:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 10:04:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 10:04:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:04:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 10:04:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:04:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:04:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:04:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:04:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:04:58 [DEBUG   ] Finished updating board flags in 1.200 seconds
2019-01-16 10:05:02 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-16 10:05:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 10:05:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:05:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-16 10:05:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:05:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:05:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:05:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:05:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:05:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:05:58 [DEBUG   ] Finished updating board flags in 1.230 seconds
2019-01-16 10:06:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:06:05 [DEBUG   ] Got command RPT from MCS: ref #1185161
2019-01-16 10:06:05 [DEBUG   ] summary = ERROR
2019-01-16 10:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185161  13 58499 36365285 A  ERRORERROR'
2019-01-16 10:06:05 [DEBUG   ] Got command RPT from MCS: ref #1185162
2019-01-16 10:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185162  77 58499 36365286 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:06:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 10:06:40 [DEBUG   ] Got command RPT from MCS: ref #1185180
2019-01-16 10:06:40 [DEBUG   ] summary = ERROR
2019-01-16 10:06:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185180  13 58499 36400897 A  ERRORERROR'
2019-01-16 10:06:41 [DEBUG   ] Got command RPT from MCS: ref #1185181
2019-01-16 10:06:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:06:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185181  77 58499 36401101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:06:41 [DEBUG   ] Got command RPT from MCS: ref #1185182
2019-01-16 10:06:41 [DEBUG   ] summary = ERROR
2019-01-16 10:06:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185182  13 58499 36401305 A  ERRORERROR'
2019-01-16 10:06:41 [DEBUG   ] Got command RPT from MCS: ref #1185184
2019-01-16 10:06:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:06:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185184  77 58499 36401497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:06:41 [DEBUG   ] Got command RPT from MCS: ref #1185185
2019-01-16 10:06:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 10:06:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185185  12 58499 36401701 A  ERRORB˜™š'
2019-01-16 10:06:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:06:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 10:06:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-16 10:06:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:06:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:06:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:06:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:06:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:06:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:06:58 [DEBUG   ] Finished updating board flags in 1.167 seconds
2019-01-16 10:07:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:07:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:07:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:07:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:07:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:07:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:07:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:07:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:07:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:07:58 [DEBUG   ] Finished updating board flags in 1.026 seconds
2019-01-16 10:08:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:08:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 10:08:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:08:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:08:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:08:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:08:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:08:58 [WARNING ] (13, 1, 'bot')
2019-01-16 10:08:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:08:58 [DEBUG   ] Finished updating board flags in 0.973 seconds
2019-01-16 10:09:03 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-16 10:09:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 10:09:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 10:09:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:09:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:09:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:09:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:09:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:09:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:09:59 [DEBUG   ] Finished updating board flags in 1.373 seconds
2019-01-16 10:10:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 10:10:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 10:10:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 10:10:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:10:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:10:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:10:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:10:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:10:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:10:59 [DEBUG   ] Finished updating board flags in 1.269 seconds
2019-01-16 10:11:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-16 10:11:05 [DEBUG   ] Got command RPT from MCS: ref #1185194
2019-01-16 10:11:05 [DEBUG   ] summary = ERROR
2019-01-16 10:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185194  13 58499 36665289 A  ERRORERROR'
2019-01-16 10:11:05 [DEBUG   ] Got command RPT from MCS: ref #1185195
2019-01-16 10:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185195  77 58499 36665290 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:11:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 10:11:40 [DEBUG   ] Got command RPT from MCS: ref #1185211
2019-01-16 10:11:40 [DEBUG   ] summary = ERROR
2019-01-16 10:11:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185211  13 58499 36700981 A  ERRORERROR'
2019-01-16 10:11:41 [DEBUG   ] Got command RPT from MCS: ref #1185212
2019-01-16 10:11:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:11:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185212  77 58499 36701185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:11:41 [DEBUG   ] Got command RPT from MCS: ref #1185213
2019-01-16 10:11:41 [DEBUG   ] summary = ERROR
2019-01-16 10:11:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185213  13 58499 36701389 A  ERRORERROR'
2019-01-16 10:11:41 [DEBUG   ] Got command RPT from MCS: ref #1185214
2019-01-16 10:11:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:11:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185214  77 58499 36701593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:11:41 [DEBUG   ] Got command RPT from MCS: ref #1185215
2019-01-16 10:11:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 10:11:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185215  12 58499 36701785 A  ERRORB˜™š'
2019-01-16 10:11:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 10:11:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:11:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:11:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:11:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:11:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:11:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:11:59 [DEBUG   ] Finished updating board flags in 1.123 seconds
2019-01-16 10:12:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 10:12:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 10:12:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 10:12:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:12:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:12:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:12:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:12:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:12:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:12:59 [DEBUG   ] Finished updating board flags in 1.014 seconds
2019-01-16 10:13:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-16 10:13:23 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-16 10:13:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 10:13:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:13:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 10:13:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:13:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:13:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:13:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:13:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:13:59 [DEBUG   ] Finished updating board flags in 0.991 seconds
2019-01-16 10:14:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 10:14:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 10:14:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 10:14:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:15:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 10:15:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 10:15:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:15:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:15:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:15:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:15:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:15:00 [DEBUG   ] Finished updating board flags in 1.807 seconds
2019-01-16 10:15:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 10:15:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 10:15:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 10:15:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 10:15:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:15:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:15:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:15:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:15:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:15:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:15:59 [DEBUG   ] Finished updating board flags in 1.237 seconds
2019-01-16 10:16:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 10:16:05 [DEBUG   ] Got command RPT from MCS: ref #1185224
2019-01-16 10:16:05 [DEBUG   ] summary = ERROR
2019-01-16 10:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185224  13 58499 36965293 A  ERRORERROR'
2019-01-16 10:16:05 [DEBUG   ] Got command RPT from MCS: ref #1185225
2019-01-16 10:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185225  77 58499 36965294 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:16:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 10:16:41 [DEBUG   ] Got command RPT from MCS: ref #1185243
2019-01-16 10:16:41 [DEBUG   ] summary = ERROR
2019-01-16 10:16:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185243  13 58499 37001073 A  ERRORERROR'
2019-01-16 10:16:41 [DEBUG   ] Got command RPT from MCS: ref #1185244
2019-01-16 10:16:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:16:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185244  77 58499 37001277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:16:41 [DEBUG   ] Got command RPT from MCS: ref #1185245
2019-01-16 10:16:41 [DEBUG   ] summary = ERROR
2019-01-16 10:16:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185245  13 58499 37001469 A  ERRORERROR'
2019-01-16 10:16:41 [DEBUG   ] Got command RPT from MCS: ref #1185247
2019-01-16 10:16:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:16:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185247  77 58499 37001673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:16:41 [DEBUG   ] Got command RPT from MCS: ref #1185248
2019-01-16 10:16:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 10:16:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185248  12 58499 37001877 A  ERRORB˜™š'
2019-01-16 10:16:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 10:16:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:16:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 10:16:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:16:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:16:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:16:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:16:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:16:59 [DEBUG   ] Finished updating board flags in 1.243 seconds
2019-01-16 10:17:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 10:17:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 10:17:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 10:17:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 10:17:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:17:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:17:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:17:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:17:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:17:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:17:59 [DEBUG   ] Finished updating board flags in 1.243 seconds
2019-01-16 10:18:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 10:18:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 10:18:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 10:18:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 10:18:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:18:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:18:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:18:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:18:59 [WARNING ] (13, 1, 'bot')
2019-01-16 10:18:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:18:59 [DEBUG   ] Finished updating board flags in 1.149 seconds
2019-01-16 10:19:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 10:19:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 10:19:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 10:19:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 10:19:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:20:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:20:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:20:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:20:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:20:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:20:00 [DEBUG   ] Finished updating board flags in 1.566 seconds
2019-01-16 10:20:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 10:20:23 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-16 10:20:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:20:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 10:20:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:21:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:21:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:21:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:21:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:21:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:21:00 [DEBUG   ] Finished updating board flags in 1.408 seconds
2019-01-16 10:21:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:21:05 [DEBUG   ] Got command RPT from MCS: ref #1185261
2019-01-16 10:21:05 [DEBUG   ] summary = ERROR
2019-01-16 10:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185261  13 58499 37265293 A  ERRORERROR'
2019-01-16 10:21:05 [DEBUG   ] Got command RPT from MCS: ref #1185262
2019-01-16 10:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185262  77 58499 37265294 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:21:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:21:41 [DEBUG   ] Got command RPT from MCS: ref #1185278
2019-01-16 10:21:41 [DEBUG   ] summary = ERROR
2019-01-16 10:21:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185278  13 58499 37301149 A  ERRORERROR'
2019-01-16 10:21:41 [DEBUG   ] Got command RPT from MCS: ref #1185279
2019-01-16 10:21:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:21:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185279  77 58499 37301353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:21:41 [DEBUG   ] Got command RPT from MCS: ref #1185280
2019-01-16 10:21:41 [DEBUG   ] summary = ERROR
2019-01-16 10:21:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185280  13 58499 37301557 A  ERRORERROR'
2019-01-16 10:21:41 [DEBUG   ] Got command RPT from MCS: ref #1185281
2019-01-16 10:21:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:21:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185281  77 58499 37301761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:21:41 [DEBUG   ] Got command RPT from MCS: ref #1185282
2019-01-16 10:21:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 10:21:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185282  12 58499 37301953 A  ERRORB˜™š'
2019-01-16 10:21:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:21:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:22:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:22:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:22:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:22:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:22:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:22:00 [DEBUG   ] Finished updating board flags in 1.367 seconds
2019-01-16 10:22:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:22:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:22:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:22:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:23:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:23:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:23:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:23:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:23:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:23:00 [DEBUG   ] Finished updating board flags in 1.204 seconds
2019-01-16 10:23:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:23:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-16 10:23:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 10:23:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 10:23:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:24:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:24:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:24:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:24:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:24:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:24:00 [DEBUG   ] Finished updating board flags in 1.191 seconds
2019-01-16 10:24:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 10:24:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 10:24:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 10:24:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:25:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:25:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:25:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:25:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:25:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:25:00 [DEBUG   ] Finished updating board flags in 1.066 seconds
2019-01-16 10:25:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 10:25:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 10:25:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 10:26:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:26:01 [WARNING ] (13, 1, 'bot')
2019-01-16 10:26:01 [WARNING ] (13, 1, 'bot')
2019-01-16 10:26:01 [WARNING ] (13, 1, 'bot')
2019-01-16 10:26:01 [WARNING ] (13, 1, 'bot')
2019-01-16 10:26:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:26:01 [DEBUG   ] Finished updating board flags in 1.997 seconds
2019-01-16 10:26:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 10:26:05 [DEBUG   ] Got command RPT from MCS: ref #1185287
2019-01-16 10:26:05 [DEBUG   ] summary = ERROR
2019-01-16 10:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185287  13 58499 37565297 A  ERRORERROR'
2019-01-16 10:26:05 [DEBUG   ] Got command RPT from MCS: ref #1185288
2019-01-16 10:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185288  77 58499 37565298 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:26:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 10:26:41 [DEBUG   ] Got command RPT from MCS: ref #1185306
2019-01-16 10:26:41 [DEBUG   ] summary = ERROR
2019-01-16 10:26:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185306  13 58499 37601233 A  ERRORERROR'
2019-01-16 10:26:41 [DEBUG   ] Got command RPT from MCS: ref #1185307
2019-01-16 10:26:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:26:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185307  77 58499 37601437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:26:41 [DEBUG   ] Got command RPT from MCS: ref #1185308
2019-01-16 10:26:41 [DEBUG   ] summary = ERROR
2019-01-16 10:26:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185308  13 58499 37601641 A  ERRORERROR'
2019-01-16 10:26:41 [DEBUG   ] Got command RPT from MCS: ref #1185309
2019-01-16 10:26:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:26:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185309  77 58499 37601845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:26:42 [DEBUG   ] Got command RPT from MCS: ref #1185311
2019-01-16 10:26:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 10:26:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185311  12 58499 37602037 A  ERRORB˜™š'
2019-01-16 10:26:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 10:27:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:27:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:27:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:27:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:27:00 [WARNING ] (13, 1, 'bot')
2019-01-16 10:27:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:27:00 [DEBUG   ] Finished updating board flags in 1.196 seconds
2019-01-16 10:27:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 10:27:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 10:27:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 10:28:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:28:01 [WARNING ] (13, 1, 'bot')
2019-01-16 10:28:01 [WARNING ] (13, 1, 'bot')
2019-01-16 10:28:01 [WARNING ] (13, 1, 'bot')
2019-01-16 10:28:01 [WARNING ] (13, 1, 'bot')
2019-01-16 10:28:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:28:01 [DEBUG   ] Finished updating board flags in 1.577 seconds
2019-01-16 10:28:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 10:28:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 10:28:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 10:29:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:29:01 [WARNING ] (13, 1, 'bot')
2019-01-16 10:29:01 [WARNING ] (13, 1, 'bot')
2019-01-16 10:29:01 [WARNING ] (13, 1, 'bot')
2019-01-16 10:29:01 [WARNING ] (13, 1, 'bot')
2019-01-16 10:29:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:29:01 [DEBUG   ] Finished updating board flags in 1.371 seconds
2019-01-16 10:29:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 10:29:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 10:29:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 10:30:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:30:00 [DEBUG   ] Got command RPT from MCS: ref #1185324
2019-01-16 10:30:00 [DEBUG   ] summary = ERROR
2019-01-16 10:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185324  13 58499 37800977 A  ERRORERROR'
2019-01-16 10:30:00 [DEBUG   ] Got command RPT from MCS: ref #1185325
2019-01-16 10:30:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185325  77 58499 37800978 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:30:01 [WARNING ] (13, 1, 'bot')
2019-01-16 10:30:01 [WARNING ] (13, 1, 'bot')
2019-01-16 10:30:01 [WARNING ] (13, 1, 'bot')
2019-01-16 10:30:01 [WARNING ] (13, 1, 'bot')
2019-01-16 10:30:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:30:01 [DEBUG   ] Finished updating board flags in 1.219 seconds
2019-01-16 10:30:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 10:30:05 [DEBUG   ] Got command INI from MCS: ref #1185326
2019-01-16 10:30:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2019-01-16 10:30:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI  1185326   8 58499 37805986 ABOOTING'
2019-01-16 10:30:26 [INFO    ] -------------------
2019-01-16 10:30:26 [INFO    ]  LWA board status
2019-01-16 10:30:26 [INFO    ] -------------------
2019-01-16 10:30:26 [INFO    ] DP 1: 2 lwa27
2019-01-16 10:30:26 [INFO    ] DP 1: 3 lwa24
2019-01-16 10:30:26 [INFO    ] DP 1: 4 lwa23
2019-01-16 10:30:26 [INFO    ] DP 1: 5 lwa18
2019-01-16 10:30:26 [INFO    ] DP 1: 6 lwa10
2019-01-16 10:30:26 [INFO    ] DP 1: 7 lwa32
2019-01-16 10:30:26 [INFO    ] DP 1: 8 lwa11
2019-01-16 10:30:26 [INFO    ] DP 1: 9 lwa30
2019-01-16 10:30:26 [INFO    ] DP 1: 10 lwa12
2019-01-16 10:30:26 [INFO    ] DP 1: 11 lwa8
2019-01-16 10:30:26 [INFO    ] DP 1: 12 lwa13
2019-01-16 10:30:26 [INFO    ] DP 1: 13 lwa26
2019-01-16 10:30:26 [INFO    ] DP 1: 14 lwa14
2019-01-16 10:30:26 [INFO    ] DP 1: 16 lwa22
2019-01-16 10:30:26 [INFO    ] DP 1: 17 lwa20
2019-01-16 10:30:26 [INFO    ] DP 1: 18 lwa1
2019-01-16 10:30:26 [INFO    ] DP 1: 19 lwa5
2019-01-16 10:30:26 [INFO    ] DP 1: 20 lwa25
2019-01-16 10:30:26 [INFO    ] DP 1: 21 lwa35
2019-01-16 10:30:26 [INFO    ] DP 1: 22 lwa19
2019-01-16 10:30:26 [INFO    ] DP 1: 23 lwa21
2019-01-16 10:30:26 [INFO    ] DP 1: 24 lwa6
2019-01-16 10:30:26 [INFO    ] DP 1: 25 lwa7
2019-01-16 10:30:26 [INFO    ] DP 1: 26 lwa33
2019-01-16 10:30:26 [INFO    ] DP 1: 27 lwa15
2019-01-16 10:30:26 [INFO    ] DP 1: 28 lwa28
2019-01-16 10:30:26 [INFO    ] DP 2: 1 lwa16
2019-01-16 10:30:26 [INFO    ] DP 2: 15 lwa34
2019-01-16 10:30:26 [INFO    ] Total of 28 boards
2019-01-16 10:30:26 [INFO    ] Total of 260 stands
2019-01-16 10:30:26 [INFO    ] -------------------
2019-01-16 10:30:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11761
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11762
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11763
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11764
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11765
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11766
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11767
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11768
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11769
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11770
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11771
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11772
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11773
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11774
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11775
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11776
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11777
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11778
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11779
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11780
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11781
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11782
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11783
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11784
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11785
2019-01-16 10:30:33 [DEBUG   ] 2019-01-16 10:30:33 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11786
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11761 exited with status 0
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11762 exited with status 0
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11763 exited with status 0
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11764 exited with status 0
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11765 exited with status 0
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11766 exited with status 0
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11767 exited with status 0
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11768 exited with status 0
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11769 exited with status 0
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11770 exited with status 0
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11771 exited with status 0
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11772 exited with status 0
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11773 exited with status 0
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11774 exited with status 0
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11775 exited with status 0
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11776 exited with status 0
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11777 exited with status 0
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11778 exited with status 0
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11779 exited with status 0
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11780 exited with status 0
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11781 exited with status 0
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11782 exited with status 0
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11783 exited with status 0
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11784 exited with status 0
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11785 exited with status 0
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11786 exited with status 0
2019-01-16 10:30:45 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] spawn_process: at 2019-01-16 10:30:45 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 11813
2019-01-16 10:30:45 [DEBUG   ] 2019-01-16 10:30:45 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 11814
2019-01-16 10:30:51 [DEBUG   ] 2019-01-16 10:30:51 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 11813 exited with status 0
2019-01-16 10:30:51 [DEBUG   ] 2019-01-16 10:30:51 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 11814 exited with status 0
2019-01-16 10:30:51 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2019-01-16 10:30:51 [DEBUG   ] spawn_process: at 2019-01-16 10:30:51 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2019-01-16 10:30:51 [DEBUG   ] spawn_process: at 2019-01-16 10:30:51 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2019-01-16 10:30:51 [INFO    ] Setting Beam 1 xbars
2019-01-16 10:30:51 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2019-01-16 10:30:51 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2019-01-16 10:30:51 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2019-01-16 10:30:51 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2019-01-16 10:30:51 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2019-01-16 10:30:52 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2019-01-16 10:30:52 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2019-01-16 10:30:52 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2019-01-16 10:30:52 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2019-01-16 10:30:52 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2019-01-16 10:30:52 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2019-01-16 10:30:52 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2019-01-16 10:30:52 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2019-01-16 10:30:52 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2019-01-16 10:30:53 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2019-01-16 10:30:53 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2019-01-16 10:30:53 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2019-01-16 10:30:53 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2019-01-16 10:30:53 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2019-01-16 10:30:53 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2019-01-16 10:30:53 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2019-01-16 10:30:53 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2019-01-16 10:30:53 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2019-01-16 10:30:53 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2019-01-16 10:30:54 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2019-01-16 10:30:54 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2019-01-16 10:30:54 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2019-01-16 10:30:54 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2019-01-16 10:30:54 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2019-01-16 10:30:54 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2019-01-16 10:30:54 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2019-01-16 10:30:54 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2019-01-16 10:30:54 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2019-01-16 10:30:55 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2019-01-16 10:30:55 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2019-01-16 10:30:55 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2019-01-16 10:30:55 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2019-01-16 10:30:55 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2019-01-16 10:30:55 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2019-01-16 10:30:55 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2019-01-16 10:30:55 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2019-01-16 10:30:55 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2019-01-16 10:30:56 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2019-01-16 10:30:56 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2019-01-16 10:30:56 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2019-01-16 10:30:56 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2019-01-16 10:30:56 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2019-01-16 10:30:56 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2019-01-16 10:30:56 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2019-01-16 10:30:56 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2019-01-16 10:30:56 [INFO    ] Setting Beam 2 xbars
2019-01-16 10:30:56 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2019-01-16 10:30:57 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2019-01-16 10:30:57 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2019-01-16 10:30:57 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2019-01-16 10:30:57 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2019-01-16 10:30:57 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2019-01-16 10:30:57 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2019-01-16 10:30:57 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2019-01-16 10:30:57 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2019-01-16 10:30:57 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2019-01-16 10:30:57 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2019-01-16 10:30:58 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2019-01-16 10:30:58 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2019-01-16 10:30:58 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2019-01-16 10:30:58 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2019-01-16 10:30:58 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2019-01-16 10:30:58 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2019-01-16 10:30:58 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2019-01-16 10:30:58 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2019-01-16 10:30:58 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2019-01-16 10:30:59 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2019-01-16 10:30:59 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2019-01-16 10:30:59 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2019-01-16 10:30:59 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2019-01-16 10:30:59 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2019-01-16 10:30:59 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2019-01-16 10:30:59 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2019-01-16 10:30:59 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2019-01-16 10:30:59 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2019-01-16 10:31:00 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2019-01-16 10:31:00 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2019-01-16 10:31:00 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2019-01-16 10:31:00 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2019-01-16 10:31:00 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2019-01-16 10:31:00 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2019-01-16 10:31:00 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2019-01-16 10:31:00 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2019-01-16 10:31:00 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2019-01-16 10:31:00 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2019-01-16 10:31:01 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2019-01-16 10:31:01 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2019-01-16 10:31:01 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2019-01-16 10:31:01 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2019-01-16 10:31:01 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2019-01-16 10:31:01 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2019-01-16 10:31:01 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2019-01-16 10:31:01 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2019-01-16 10:31:01 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2019-01-16 10:31:02 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2019-01-16 10:31:02 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2019-01-16 10:31:02 [INFO    ] Setting Beam 3 xbars
2019-01-16 10:31:02 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2019-01-16 10:31:02 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2019-01-16 10:31:02 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2019-01-16 10:31:02 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2019-01-16 10:31:02 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2019-01-16 10:31:02 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2019-01-16 10:31:02 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2019-01-16 10:31:03 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2019-01-16 10:31:03 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2019-01-16 10:31:03 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2019-01-16 10:31:03 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2019-01-16 10:31:03 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2019-01-16 10:31:03 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2019-01-16 10:31:03 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2019-01-16 10:31:03 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2019-01-16 10:31:03 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2019-01-16 10:31:04 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2019-01-16 10:31:04 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2019-01-16 10:31:04 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2019-01-16 10:31:04 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2019-01-16 10:31:04 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2019-01-16 10:31:04 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2019-01-16 10:31:04 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2019-01-16 10:31:04 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2019-01-16 10:31:04 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2019-01-16 10:31:05 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2019-01-16 10:31:05 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2019-01-16 10:31:05 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2019-01-16 10:31:05 [DEBUG   ] Got command RPT from MCS: ref #1185327
2019-01-16 10:31:05 [DEBUG   ] summary = BOOTING
2019-01-16 10:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185327  15 58499 37865293 ABOOTINGBOOTING'
2019-01-16 10:31:05 [DEBUG   ] Got command RPT from MCS: ref #1185328
2019-01-16 10:31:05 [DEBUG   ] info = Starting calibration
2019-01-16 10:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185328  28 58499 37865294 ABOOTINGStarting calibration'
2019-01-16 10:31:05 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2019-01-16 10:31:05 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2019-01-16 10:31:05 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2019-01-16 10:31:05 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2019-01-16 10:31:05 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2019-01-16 10:31:05 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2019-01-16 10:31:05 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2019-01-16 10:31:06 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2019-01-16 10:31:06 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2019-01-16 10:31:06 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2019-01-16 10:31:06 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2019-01-16 10:31:06 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2019-01-16 10:31:06 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2019-01-16 10:31:06 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2019-01-16 10:31:06 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2019-01-16 10:31:06 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2019-01-16 10:31:07 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2019-01-16 10:31:07 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2019-01-16 10:31:07 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2019-01-16 10:31:07 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2019-01-16 10:31:07 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2019-01-16 10:31:07 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2019-01-16 10:31:07 [INFO    ] Setting Beam 4 xbars
2019-01-16 10:31:07 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2019-01-16 10:31:07 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-01-16 10:31:07 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-01-16 10:31:08 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-01-16 10:31:08 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-01-16 10:31:08 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2019-01-16 10:31:08 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2019-01-16 10:31:08 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2019-01-16 10:31:08 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2019-01-16 10:31:08 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2019-01-16 10:31:08 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2019-01-16 10:31:08 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2019-01-16 10:31:09 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2019-01-16 10:31:09 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2019-01-16 10:31:09 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2019-01-16 10:31:09 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2019-01-16 10:31:09 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2019-01-16 10:31:09 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2019-01-16 10:31:09 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2019-01-16 10:31:09 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2019-01-16 10:31:09 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2019-01-16 10:31:10 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2019-01-16 10:31:10 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2019-01-16 10:31:10 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2019-01-16 10:31:10 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2019-01-16 10:31:10 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2019-01-16 10:31:10 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2019-01-16 10:31:10 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2019-01-16 10:31:10 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2019-01-16 10:31:10 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2019-01-16 10:31:11 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2019-01-16 10:31:11 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2019-01-16 10:31:11 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2019-01-16 10:31:11 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2019-01-16 10:31:11 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2019-01-16 10:31:11 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2019-01-16 10:31:11 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2019-01-16 10:31:11 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2019-01-16 10:31:11 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2019-01-16 10:31:12 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2019-01-16 10:31:12 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2019-01-16 10:31:12 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2019-01-16 10:31:12 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2019-01-16 10:31:12 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2019-01-16 10:31:12 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2019-01-16 10:31:12 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2019-01-16 10:31:12 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2019-01-16 10:31:12 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2019-01-16 10:31:12 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2019-01-16 10:31:13 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2019-01-16 10:31:13 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2019-01-16 10:31:13 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2019-01-16 10:31:13 [INFO    ] All xbars set
2019-01-16 10:31:13 [INFO    ] Setting adder chain routing for all beams
2019-01-16 10:31:18 [INFO    ] Setting beam ids
2019-01-16 10:31:28 [INFO    ] Starting beam delay calibration
2019-01-16 10:31:40 [INFO    ] Beam 1 latency is 5717
2019-01-16 10:31:40 [INFO    ] Beam 2 latency is 5738
2019-01-16 10:31:40 [INFO    ] Beam 3 latency is 5726
2019-01-16 10:31:40 [INFO    ] Beam 4 latency is 5707
2019-01-16 10:31:40 [INFO    ] Stop calibration
2019-01-16 10:31:41 [DEBUG   ] Got command RPT from MCS: ref #1185344
2019-01-16 10:31:41 [DEBUG   ] summary = BOOTING
2019-01-16 10:31:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185344  15 58499 37901325 ABOOTINGBOOTING'
2019-01-16 10:31:48 [INFO    ] Beam delay calibration successful
2019-01-16 10:31:48 [INFO    ] Calibration passed
2019-01-16 10:31:48 [DEBUG   ] spawn_process: at 2019-01-16 10:31:48 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2019-01-16 10:31:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2019-01-16 10:31:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2019-01-16 10:31:48 [DEBUG   ] spawn_process: at 2019-01-16 10:31:48 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2019-01-16 10:31:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2019-01-16 10:31:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2019-01-16 10:31:48 [DEBUG   ] spawn_process: at 2019-01-16 10:31:48 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2019-01-16 10:31:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2019-01-16 10:31:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2019-01-16 10:31:48 [DEBUG   ] spawn_process: at 2019-01-16 10:31:48 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2019-01-16 10:31:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2019-01-16 10:31:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2019-01-16 10:31:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2019-01-16 10:31:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 558 ms (1547634708.561 s) with PID 13376 and time 1547634709
2019-01-16 10:31:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2019-01-16 10:31:49 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 295 ms (1547634709.298 s) with PID 13397 and time 1547634710
2019-01-16 10:31:50 [DEBUG   ] Finished updating ant stats in 0.949 seconds
2019-01-16 10:31:50 [INFO    ] Started antennas statistics background thread
2019-01-16 10:31:50 [INFO    ] Started board flags background thread
2019-01-16 10:31:50 [INFO    ] Started BAM background thread
2019-01-16 10:31:50 [INFO    ] Finished the INI process (ref. #1185326) in 104.436 s
2019-01-16 10:31:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 10:31:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:31:51 [WARNING ] (13, 1, 'bot')
2019-01-16 10:31:51 [WARNING ] (13, 1, 'bot')
2019-01-16 10:31:51 [WARNING ] (13, 1, 'bot')
2019-01-16 10:31:51 [WARNING ] (13, 1, 'bot')
2019-01-16 10:31:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:31:51 [DEBUG   ] Finished updating board flags in 1.136 seconds
2019-01-16 10:32:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 10:32:30 [DEBUG   ] Finished updating ant stats in 0.783 seconds
2019-01-16 10:32:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 10:32:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:32:51 [WARNING ] (13, 1, 'bot')
2019-01-16 10:32:51 [WARNING ] (13, 1, 'bot')
2019-01-16 10:32:51 [WARNING ] (13, 1, 'bot')
2019-01-16 10:32:51 [WARNING ] (13, 1, 'bot')
2019-01-16 10:32:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:32:51 [DEBUG   ] Finished updating board flags in 0.989 seconds
2019-01-16 10:33:05 [DEBUG   ] Got command RPT from MCS: ref #1185349
2019-01-16 10:33:05 [DEBUG   ] summary = ERROR
2019-01-16 10:33:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185349  13 58499 37985989 A  ERRORERROR'
2019-01-16 10:33:05 [DEBUG   ] Got command RPT from MCS: ref #1185350
2019-01-16 10:33:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:33:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185350  77 58499 37985990 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:33:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 10:33:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 10:33:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 10:33:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 10:33:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:33:51 [WARNING ] (13, 1, 'bot')
2019-01-16 10:33:51 [WARNING ] (13, 1, 'bot')
2019-01-16 10:33:51 [WARNING ] (13, 1, 'bot')
2019-01-16 10:33:51 [WARNING ] (13, 1, 'bot')
2019-01-16 10:33:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:33:51 [DEBUG   ] Finished updating board flags in 1.330 seconds
2019-01-16 10:34:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 10:34:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 10:34:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 10:34:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:34:51 [WARNING ] (13, 1, 'bot')
2019-01-16 10:34:51 [WARNING ] (13, 1, 'bot')
2019-01-16 10:34:51 [WARNING ] (13, 1, 'bot')
2019-01-16 10:34:51 [WARNING ] (13, 1, 'bot')
2019-01-16 10:34:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:34:51 [DEBUG   ] Finished updating board flags in 1.133 seconds
2019-01-16 10:35:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 10:35:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 10:35:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 10:35:51 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 10:35:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:35:51 [WARNING ] (13, 1, 'bot')
2019-01-16 10:35:51 [WARNING ] (13, 1, 'bot')
2019-01-16 10:35:51 [WARNING ] (13, 1, 'bot')
2019-01-16 10:35:51 [WARNING ] (13, 1, 'bot')
2019-01-16 10:35:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:35:51 [DEBUG   ] Finished updating board flags in 1.031 seconds
2019-01-16 10:36:05 [DEBUG   ] Got command RPT from MCS: ref #1185355
2019-01-16 10:36:05 [DEBUG   ] summary = ERROR
2019-01-16 10:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185355  13 58499 38165293 A  ERRORERROR'
2019-01-16 10:36:05 [DEBUG   ] Got command RPT from MCS: ref #1185356
2019-01-16 10:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185356  77 58499 38165294 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:36:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 10:36:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 10:36:41 [DEBUG   ] Got command RPT from MCS: ref #1185374
2019-01-16 10:36:41 [DEBUG   ] summary = ERROR
2019-01-16 10:36:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185374  13 58499 38201405 A  ERRORERROR'
2019-01-16 10:36:41 [DEBUG   ] Got command RPT from MCS: ref #1185375
2019-01-16 10:36:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:36:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185375  77 58499 38201609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:36:41 [DEBUG   ] Got command RPT from MCS: ref #1185376
2019-01-16 10:36:41 [DEBUG   ] summary = ERROR
2019-01-16 10:36:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185376  13 58499 38201813 A  ERRORERROR'
2019-01-16 10:36:42 [DEBUG   ] Got command RPT from MCS: ref #1185378
2019-01-16 10:36:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:36:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185378  77 58499 38202005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:36:42 [DEBUG   ] Got command RPT from MCS: ref #1185379
2019-01-16 10:36:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 10:36:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185379  12 58499 38202209 A  ERRORB˜™š'
2019-01-16 10:36:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 10:36:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:36:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:36:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:36:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:36:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:36:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:36:52 [DEBUG   ] Finished updating board flags in 1.552 seconds
2019-01-16 10:37:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 10:37:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 10:37:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 10:37:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:37:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:37:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:37:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:37:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:37:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:37:52 [DEBUG   ] Finished updating board flags in 1.367 seconds
2019-01-16 10:38:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 10:38:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 10:38:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 10:38:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:38:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:38:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:38:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:38:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:38:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:38:52 [DEBUG   ] Finished updating board flags in 1.265 seconds
2019-01-16 10:39:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 10:39:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 10:39:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 10:39:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:39:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:39:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:39:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:39:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:39:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:39:52 [DEBUG   ] Finished updating board flags in 1.152 seconds
2019-01-16 10:40:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 10:40:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 10:40:50 [DEBUG   ] Finished updating ant stats in 0.575 seconds
2019-01-16 10:40:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:40:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:40:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:40:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:40:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:40:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:40:52 [DEBUG   ] Finished updating board flags in 1.019 seconds
2019-01-16 10:41:05 [DEBUG   ] Got command RPT from MCS: ref #1185388
2019-01-16 10:41:05 [DEBUG   ] summary = ERROR
2019-01-16 10:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185388  13 58499 38465297 A  ERRORERROR'
2019-01-16 10:41:05 [DEBUG   ] Got command RPT from MCS: ref #1185389
2019-01-16 10:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185389  77 58499 38465298 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:41:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 10:41:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 10:41:41 [DEBUG   ] Got command RPT from MCS: ref #1185405
2019-01-16 10:41:41 [DEBUG   ] summary = ERROR
2019-01-16 10:41:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185405  13 58499 38501493 A  ERRORERROR'
2019-01-16 10:41:41 [DEBUG   ] Got command RPT from MCS: ref #1185406
2019-01-16 10:41:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:41:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185406  77 58499 38501697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:41:41 [DEBUG   ] Got command RPT from MCS: ref #1185407
2019-01-16 10:41:41 [DEBUG   ] summary = ERROR
2019-01-16 10:41:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185407  13 58499 38501889 A  ERRORERROR'
2019-01-16 10:41:42 [DEBUG   ] Got command RPT from MCS: ref #1185408
2019-01-16 10:41:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:41:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185408  77 58499 38502093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:41:42 [DEBUG   ] Got command RPT from MCS: ref #1185409
2019-01-16 10:41:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 10:41:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185409  12 58499 38502297 A  ERRORB˜™š'
2019-01-16 10:41:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 10:41:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:41:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 10:41:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:41:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:41:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:41:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:41:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:41:53 [DEBUG   ] Finished updating board flags in 1.991 seconds
2019-01-16 10:42:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 10:42:30 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-16 10:42:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:42:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 10:42:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:42:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:42:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:42:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:42:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:42:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:42:53 [DEBUG   ] Finished updating board flags in 1.777 seconds
2019-01-16 10:43:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 10:43:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:43:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:43:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:43:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:43:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:43:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:43:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:43:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:43:52 [DEBUG   ] Finished updating board flags in 1.062 seconds
2019-01-16 10:44:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:44:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:44:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:44:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:44:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:44:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:44:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:44:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:44:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:44:52 [DEBUG   ] Finished updating board flags in 1.021 seconds
2019-01-16 10:45:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:45:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 10:45:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 10:45:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:45:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 10:45:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:45:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:45:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:45:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:45:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:45:52 [DEBUG   ] Finished updating board flags in 1.010 seconds
2019-01-16 10:46:05 [DEBUG   ] Got command RPT from MCS: ref #1185418
2019-01-16 10:46:05 [DEBUG   ] summary = ERROR
2019-01-16 10:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185418  13 58499 38765297 A  ERRORERROR'
2019-01-16 10:46:05 [DEBUG   ] Got command RPT from MCS: ref #1185419
2019-01-16 10:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185419  77 58499 38765298 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:46:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:46:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:46:41 [DEBUG   ] Got command RPT from MCS: ref #1185437
2019-01-16 10:46:41 [DEBUG   ] summary = ERROR
2019-01-16 10:46:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185437  13 58499 38801573 A  ERRORERROR'
2019-01-16 10:46:41 [DEBUG   ] Got command RPT from MCS: ref #1185438
2019-01-16 10:46:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:46:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185438  77 58499 38801777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:46:41 [DEBUG   ] Got command RPT from MCS: ref #1185439
2019-01-16 10:46:41 [DEBUG   ] summary = ERROR
2019-01-16 10:46:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185439  13 58499 38801981 A  ERRORERROR'
2019-01-16 10:46:42 [DEBUG   ] Got command RPT from MCS: ref #1185440
2019-01-16 10:46:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:46:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185440  77 58499 38802173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:46:42 [DEBUG   ] Got command RPT from MCS: ref #1185442
2019-01-16 10:46:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 10:46:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185442  12 58499 38802377 A  ERRORB˜™š'
2019-01-16 10:46:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:46:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:46:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 10:46:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:46:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:46:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:46:52 [WARNING ] (13, 1, 'bot')
2019-01-16 10:46:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:46:52 [DEBUG   ] Finished updating board flags in 1.027 seconds
2019-01-16 10:47:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:47:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:47:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:47:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:47:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 10:47:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:47:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:47:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:47:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:47:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:47:53 [DEBUG   ] Finished updating board flags in 1.564 seconds
2019-01-16 10:48:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 10:48:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:48:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 10:48:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:48:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:48:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:48:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:48:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:48:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:48:53 [DEBUG   ] Finished updating board flags in 1.322 seconds
2019-01-16 10:49:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:49:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:49:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:49:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:49:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:49:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:49:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:49:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:49:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:49:53 [DEBUG   ] Finished updating board flags in 1.226 seconds
2019-01-16 10:50:07 [DEBUG   ] Got command DRX from MCS: ref #1185456
2019-01-16 10:50:07 [INFO    ] sending drx command to lwa16
2019-01-16 10:50:07 [DEBUG   ] run_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 1 64500000.0 7 9 0']
2019-01-16 10:50:07 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-16 10:50:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1185456   8 58499 39007013 A  ERROR'
2019-01-16 10:50:07 [DEBUG   ] Got command DRX from MCS: ref #1185455
2019-01-16 10:50:07 [INFO    ] sending drx command to lwa16
2019-01-16 10:50:07 [DEBUG   ] run_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 35100000.0 7 9 0']
2019-01-16 10:50:07 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-16 10:50:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1185455   8 58499 39007017 A  ERROR'
2019-01-16 10:50:07 [DEBUG   ] Got command DRX from MCS: ref #1185458
2019-01-16 10:50:07 [INFO    ] sending drx command to lwa16
2019-01-16 10:50:07 [DEBUG   ] run_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 2 79200000.0 7 9 0']
2019-01-16 10:50:07 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-16 10:50:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1185458   8 58499 39007021 A  ERROR'
2019-01-16 10:50:07 [DEBUG   ] Got command DRX from MCS: ref #1185457
2019-01-16 10:50:07 [INFO    ] sending drx command to lwa16
2019-01-16 10:50:07 [DEBUG   ] run_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 49800000.0 7 9 0']
2019-01-16 10:50:07 [DEBUG   ] drx = exited with status True, code 0x00
2019-01-16 10:50:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1185457   8 58499 39007025 A  ERROR'
2019-01-16 10:50:07 [DEBUG   ] Got command BAM from MCS: ref #1185459
2019-01-16 10:50:07 [INFO    ] Finished processing BAM request
2019-01-16 10:50:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:50:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185459   8 58499 39007029 A  ERROR'
2019-01-16 10:50:07 [DEBUG   ] Got command BAM from MCS: ref #1185460
2019-01-16 10:50:07 [INFO    ] Finished processing BAM request
2019-01-16 10:50:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:50:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185460   8 58499 39007033 A  ERROR'
2019-01-16 10:50:07 [INFO    ] Finished starting DRX
2019-01-16 10:50:07 [INFO    ] Finished starting DRX
2019-01-16 10:50:07 [INFO    ] Finished starting DRX
2019-01-16 10:50:07 [INFO    ] Finished starting DRX
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 10:50:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 10:50:07 [DEBUG   ] spawn_process: at 2019-01-16 10:50:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 10:50:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:50:24 [DEBUG   ] Got command BAM from MCS: ref #1185464
2019-01-16 10:50:24 [INFO    ] Finished processing BAM request
2019-01-16 10:50:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:50:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185464   8 58499 39024029 A  ERROR'
2019-01-16 10:50:24 [DEBUG   ] Got command BAM from MCS: ref #1185463
2019-01-16 10:50:24 [INFO    ] Finished processing BAM request
2019-01-16 10:50:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:50:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185463   8 58499 39024033 A  ERROR'
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 10:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 10:50:24 [DEBUG   ] spawn_process: at 2019-01-16 10:50:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 10:50:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 10:50:41 [DEBUG   ] Got command BAM from MCS: ref #1185465
2019-01-16 10:50:41 [INFO    ] Finished processing BAM request
2019-01-16 10:50:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:50:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185465   8 58499 39041029 A  ERROR'
2019-01-16 10:50:41 [DEBUG   ] Got command BAM from MCS: ref #1185466
2019-01-16 10:50:41 [INFO    ] Finished processing BAM request
2019-01-16 10:50:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:50:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185466   8 58499 39041033 A  ERROR'
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 10:50:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 10:50:41 [DEBUG   ] spawn_process: at 2019-01-16 10:50:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 10:50:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:50:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:50:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:50:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:50:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:50:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:50:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:50:53 [DEBUG   ] Finished updating board flags in 1.177 seconds
2019-01-16 10:50:58 [DEBUG   ] Got command BAM from MCS: ref #1185471
2019-01-16 10:50:58 [INFO    ] Finished processing BAM request
2019-01-16 10:50:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185471   8 58499 39058033 A  ERROR'
2019-01-16 10:50:58 [DEBUG   ] Got command BAM from MCS: ref #1185472
2019-01-16 10:50:58 [INFO    ] Finished processing BAM request
2019-01-16 10:50:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185472   8 58499 39058041 A  ERROR'
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 10:50:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 10:50:58 [DEBUG   ] spawn_process: at 2019-01-16 10:50:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 10:51:05 [DEBUG   ] Got command RPT from MCS: ref #1185473
2019-01-16 10:51:05 [DEBUG   ] summary = ERROR
2019-01-16 10:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185473  13 58499 39065297 A  ERRORERROR'
2019-01-16 10:51:05 [DEBUG   ] Got command RPT from MCS: ref #1185474
2019-01-16 10:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185474  77 58499 39065298 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:51:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 10:51:15 [DEBUG   ] Got command BAM from MCS: ref #1185490
2019-01-16 10:51:15 [INFO    ] Finished processing BAM request
2019-01-16 10:51:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:51:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185490   8 58499 39075029 A  ERROR'
2019-01-16 10:51:15 [DEBUG   ] Got command BAM from MCS: ref #1185491
2019-01-16 10:51:15 [INFO    ] Finished processing BAM request
2019-01-16 10:51:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:51:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185491   8 58499 39075033 A  ERROR'
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 10:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 10:51:15 [DEBUG   ] spawn_process: at 2019-01-16 10:51:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 10:51:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:51:32 [DEBUG   ] Got command BAM from MCS: ref #1185493
2019-01-16 10:51:32 [INFO    ] Finished processing BAM request
2019-01-16 10:51:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:51:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185493   8 58499 39092037 A  ERROR'
2019-01-16 10:51:32 [DEBUG   ] Got command BAM from MCS: ref #1185492
2019-01-16 10:51:32 [INFO    ] Finished processing BAM request
2019-01-16 10:51:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:51:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185492   8 58499 39092045 A  ERROR'
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 10:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 10:51:32 [DEBUG   ] spawn_process: at 2019-01-16 10:51:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 10:51:41 [DEBUG   ] Got command RPT from MCS: ref #1185494
2019-01-16 10:51:41 [DEBUG   ] summary = ERROR
2019-01-16 10:51:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185494  13 58499 39101665 A  ERRORERROR'
2019-01-16 10:51:41 [DEBUG   ] Got command RPT from MCS: ref #1185495
2019-01-16 10:51:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:51:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185495  77 58499 39101870 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:51:42 [DEBUG   ] Got command RPT from MCS: ref #1185496
2019-01-16 10:51:42 [DEBUG   ] summary = ERROR
2019-01-16 10:51:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185496  13 58499 39102061 A  ERRORERROR'
2019-01-16 10:51:42 [DEBUG   ] Got command RPT from MCS: ref #1185497
2019-01-16 10:51:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:51:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185497  77 58499 39102265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:51:42 [DEBUG   ] Got command RPT from MCS: ref #1185498
2019-01-16 10:51:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 10:51:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185498  12 58499 39102469 A  ERRORBœ™š'
2019-01-16 10:51:49 [DEBUG   ] Got command BAM from MCS: ref #1185500
2019-01-16 10:51:49 [INFO    ] Finished processing BAM request
2019-01-16 10:51:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:51:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185500   8 58499 39109025 A  ERROR'
2019-01-16 10:51:49 [DEBUG   ] Got command BAM from MCS: ref #1185499
2019-01-16 10:51:49 [INFO    ] Finished processing BAM request
2019-01-16 10:51:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:51:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185499   8 58499 39109029 A  ERROR'
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 10:51:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 10:51:49 [DEBUG   ] spawn_process: at 2019-01-16 10:51:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 10:51:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 10:51:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 10:51:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:51:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-16 10:51:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 10:51:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:51:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:51:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:51:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:51:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:51:53 [DEBUG   ] Finished updating board flags in 1.013 seconds
2019-01-16 10:52:06 [DEBUG   ] Got command BAM from MCS: ref #1185502
2019-01-16 10:52:06 [INFO    ] Finished processing BAM request
2019-01-16 10:52:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:52:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185502   8 58499 39126029 A  ERROR'
2019-01-16 10:52:06 [DEBUG   ] Got command BAM from MCS: ref #1185501
2019-01-16 10:52:06 [INFO    ] Finished processing BAM request
2019-01-16 10:52:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:52:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185501   8 58499 39126033 A  ERROR'
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 10:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 10:52:06 [DEBUG   ] spawn_process: at 2019-01-16 10:52:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 10:52:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:52:22 [DEBUG   ] Got command BAM from MCS: ref #1185503
2019-01-16 10:52:22 [INFO    ] Finished processing BAM request
2019-01-16 10:52:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:52:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185503   8 58499 39142033 A  ERROR'
2019-01-16 10:52:22 [DEBUG   ] Got command BAM from MCS: ref #1185504
2019-01-16 10:52:22 [INFO    ] Finished processing BAM request
2019-01-16 10:52:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:52:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185504   8 58499 39142037 A  ERROR'
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 10:52:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 10:52:22 [DEBUG   ] spawn_process: at 2019-01-16 10:52:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 10:52:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:52:38 [DEBUG   ] Got command BAM from MCS: ref #1185506
2019-01-16 10:52:38 [INFO    ] Finished processing BAM request
2019-01-16 10:52:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:52:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185506   8 58499 39158025 A  ERROR'
2019-01-16 10:52:38 [DEBUG   ] Got command BAM from MCS: ref #1185505
2019-01-16 10:52:38 [INFO    ] Finished processing BAM request
2019-01-16 10:52:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:52:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185505   8 58499 39158029 A  ERROR'
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 10:52:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 10:52:38 [DEBUG   ] spawn_process: at 2019-01-16 10:52:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 10:52:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:52:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:52:53 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-01-16 10:52:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:52:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:52:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:52:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:52:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:52:53 [DEBUG   ] Finished updating board flags in 0.991 seconds
2019-01-16 10:52:54 [DEBUG   ] Got command BAM from MCS: ref #1185508
2019-01-16 10:52:54 [INFO    ] Finished processing BAM request
2019-01-16 10:52:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:52:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185508   8 58499 39174033 A  ERROR'
2019-01-16 10:52:54 [DEBUG   ] Got command BAM from MCS: ref #1185507
2019-01-16 10:52:54 [INFO    ] Finished processing BAM request
2019-01-16 10:52:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:52:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185507   8 58499 39174041 A  ERROR'
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 10:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 10:52:54 [DEBUG   ] spawn_process: at 2019-01-16 10:52:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 10:53:10 [DEBUG   ] Got command BAM from MCS: ref #1185509
2019-01-16 10:53:10 [INFO    ] Finished processing BAM request
2019-01-16 10:53:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:53:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185509   8 58499 39190025 A  ERROR'
2019-01-16 10:53:10 [DEBUG   ] Got command BAM from MCS: ref #1185510
2019-01-16 10:53:10 [INFO    ] Finished processing BAM request
2019-01-16 10:53:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:53:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185510   8 58499 39190029 A  ERROR'
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 10:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 10:53:10 [DEBUG   ] spawn_process: at 2019-01-16 10:53:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 10:53:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 10:53:26 [DEBUG   ] Got command BAM from MCS: ref #1185512
2019-01-16 10:53:26 [INFO    ] Finished processing BAM request
2019-01-16 10:53:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185512   8 58499 39206029 A  ERROR'
2019-01-16 10:53:26 [DEBUG   ] Got command BAM from MCS: ref #1185511
2019-01-16 10:53:26 [INFO    ] Finished processing BAM request
2019-01-16 10:53:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185511   8 58499 39206033 A  ERROR'
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 10:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 10:53:26 [DEBUG   ] spawn_process: at 2019-01-16 10:53:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 10:53:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:53:42 [DEBUG   ] Got command BAM from MCS: ref #1185513
2019-01-16 10:53:42 [INFO    ] Finished processing BAM request
2019-01-16 10:53:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:53:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185513   8 58499 39222029 A  ERROR'
2019-01-16 10:53:42 [DEBUG   ] Got command BAM from MCS: ref #1185514
2019-01-16 10:53:42 [INFO    ] Finished processing BAM request
2019-01-16 10:53:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:53:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185514   8 58499 39222033 A  ERROR'
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 10:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 10:53:42 [DEBUG   ] spawn_process: at 2019-01-16 10:53:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 10:53:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:53:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 10:53:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-16 10:53:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:53:54 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-16 10:53:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 10:53:54 [WARNING ] (13, 1, 'bot')
2019-01-16 10:53:54 [WARNING ] (13, 1, 'bot')
2019-01-16 10:53:54 [WARNING ] (13, 1, 'bot')
2019-01-16 10:53:54 [WARNING ] (13, 1, 'bot')
2019-01-16 10:53:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:53:54 [DEBUG   ] Finished updating board flags in 1.813 seconds
2019-01-16 10:53:58 [DEBUG   ] Got command BAM from MCS: ref #1185520
2019-01-16 10:53:58 [INFO    ] Finished processing BAM request
2019-01-16 10:53:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:53:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185520   8 58499 39238025 A  ERROR'
2019-01-16 10:53:58 [DEBUG   ] Got command BAM from MCS: ref #1185519
2019-01-16 10:53:58 [INFO    ] Finished processing BAM request
2019-01-16 10:53:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:53:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185519   8 58499 39238029 A  ERROR'
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 10:53:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 10:53:58 [DEBUG   ] spawn_process: at 2019-01-16 10:53:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 10:54:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:54:14 [DEBUG   ] Got command BAM from MCS: ref #1185521
2019-01-16 10:54:14 [INFO    ] Finished processing BAM request
2019-01-16 10:54:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:54:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185521   8 58499 39254033 A  ERROR'
2019-01-16 10:54:14 [DEBUG   ] Got command BAM from MCS: ref #1185522
2019-01-16 10:54:14 [INFO    ] Finished processing BAM request
2019-01-16 10:54:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:54:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185522   8 58499 39254037 A  ERROR'
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 10:54:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 10:54:14 [DEBUG   ] spawn_process: at 2019-01-16 10:54:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 10:54:30 [DEBUG   ] Got command BAM from MCS: ref #1185524
2019-01-16 10:54:30 [INFO    ] Finished processing BAM request
2019-01-16 10:54:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:54:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185524   8 58499 39270025 A  ERROR'
2019-01-16 10:54:30 [DEBUG   ] Got command BAM from MCS: ref #1185523
2019-01-16 10:54:30 [INFO    ] Finished processing BAM request
2019-01-16 10:54:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:54:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185523   8 58499 39270029 A  ERROR'
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 10:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 10:54:30 [DEBUG   ] spawn_process: at 2019-01-16 10:54:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 10:54:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 10:54:46 [DEBUG   ] Got command BAM from MCS: ref #1185525
2019-01-16 10:54:46 [INFO    ] Finished processing BAM request
2019-01-16 10:54:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:54:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185525   8 58499 39286025 A  ERROR'
2019-01-16 10:54:46 [DEBUG   ] Got command BAM from MCS: ref #1185526
2019-01-16 10:54:46 [INFO    ] Finished processing BAM request
2019-01-16 10:54:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:54:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185526   8 58499 39286029 A  ERROR'
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 10:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 10:54:46 [DEBUG   ] spawn_process: at 2019-01-16 10:54:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 10:54:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:54:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-16 10:54:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:54:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-16 10:54:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-01-16 10:54:53 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-01-16 10:54:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 10:54:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:54:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:54:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:54:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:54:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:54:53 [DEBUG   ] Finished updating board flags in 1.232 seconds
2019-01-16 10:55:02 [DEBUG   ] Got command BAM from MCS: ref #1185528
2019-01-16 10:55:02 [INFO    ] Finished processing BAM request
2019-01-16 10:55:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:55:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185528   8 58499 39302029 A  ERROR'
2019-01-16 10:55:02 [DEBUG   ] Got command BAM from MCS: ref #1185527
2019-01-16 10:55:02 [INFO    ] Finished processing BAM request
2019-01-16 10:55:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:55:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185527   8 58499 39302033 A  ERROR'
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 10:55:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 10:55:02 [DEBUG   ] spawn_process: at 2019-01-16 10:55:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 10:55:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:55:18 [DEBUG   ] Got command BAM from MCS: ref #1185530
2019-01-16 10:55:18 [INFO    ] Finished processing BAM request
2019-01-16 10:55:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:55:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185530   8 58499 39318033 A  ERROR'
2019-01-16 10:55:18 [DEBUG   ] Got command BAM from MCS: ref #1185529
2019-01-16 10:55:18 [INFO    ] Finished processing BAM request
2019-01-16 10:55:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:55:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185529   8 58499 39318037 A  ERROR'
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 10:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 10:55:18 [DEBUG   ] spawn_process: at 2019-01-16 10:55:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 10:55:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:55:34 [DEBUG   ] Got command BAM from MCS: ref #1185531
2019-01-16 10:55:34 [INFO    ] Finished processing BAM request
2019-01-16 10:55:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:55:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185531   8 58499 39334025 A  ERROR'
2019-01-16 10:55:34 [DEBUG   ] Got command BAM from MCS: ref #1185532
2019-01-16 10:55:34 [INFO    ] Finished processing BAM request
2019-01-16 10:55:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:55:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185532   8 58499 39334029 A  ERROR'
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 10:55:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 10:55:34 [DEBUG   ] spawn_process: at 2019-01-16 10:55:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 10:55:50 [DEBUG   ] Got command BAM from MCS: ref #1185534
2019-01-16 10:55:50 [INFO    ] Finished processing BAM request
2019-01-16 10:55:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:55:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185534   8 58499 39350029 A  ERROR'
2019-01-16 10:55:50 [DEBUG   ] Got command BAM from MCS: ref #1185533
2019-01-16 10:55:50 [INFO    ] Finished processing BAM request
2019-01-16 10:55:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:55:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185533   8 58499 39350033 A  ERROR'
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 10:55:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 10:55:50 [DEBUG   ] spawn_process: at 2019-01-16 10:55:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 10:55:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:55:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 10:55:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:55:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 10:55:53 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 10:55:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:55:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:55:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:55:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:55:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:55:53 [DEBUG   ] Finished updating board flags in 1.222 seconds
2019-01-16 10:56:05 [DEBUG   ] Got command RPT from MCS: ref #1185537
2019-01-16 10:56:05 [DEBUG   ] summary = ERROR
2019-01-16 10:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185537  13 58499 39365297 A  ERRORERROR'
2019-01-16 10:56:05 [DEBUG   ] Got command RPT from MCS: ref #1185538
2019-01-16 10:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185538  77 58499 39365298 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:56:06 [DEBUG   ] Got command BAM from MCS: ref #1185536
2019-01-16 10:56:06 [INFO    ] Finished processing BAM request
2019-01-16 10:56:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185536   8 58499 39366033 A  ERROR'
2019-01-16 10:56:06 [DEBUG   ] Got command BAM from MCS: ref #1185535
2019-01-16 10:56:06 [INFO    ] Finished processing BAM request
2019-01-16 10:56:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:56:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185535   8 58499 39366037 A  ERROR'
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 10:56:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 10:56:06 [DEBUG   ] spawn_process: at 2019-01-16 10:56:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 10:56:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:56:22 [DEBUG   ] Got command BAM from MCS: ref #1185555
2019-01-16 10:56:22 [INFO    ] Finished processing BAM request
2019-01-16 10:56:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:56:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185555   8 58499 39382033 A  ERROR'
2019-01-16 10:56:22 [DEBUG   ] Got command BAM from MCS: ref #1185554
2019-01-16 10:56:22 [INFO    ] Finished processing BAM request
2019-01-16 10:56:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:56:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185554   8 58499 39382037 A  ERROR'
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 10:56:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 10:56:22 [DEBUG   ] spawn_process: at 2019-01-16 10:56:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 10:56:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:56:38 [DEBUG   ] Got command BAM from MCS: ref #1185559
2019-01-16 10:56:38 [INFO    ] Finished processing BAM request
2019-01-16 10:56:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:56:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185559   8 58499 39398029 A  ERROR'
2019-01-16 10:56:38 [DEBUG   ] Got command BAM from MCS: ref #1185558
2019-01-16 10:56:38 [INFO    ] Finished processing BAM request
2019-01-16 10:56:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:56:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185558   8 58499 39398033 A  ERROR'
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 10:56:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 10:56:38 [DEBUG   ] spawn_process: at 2019-01-16 10:56:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 10:56:41 [DEBUG   ] Got command RPT from MCS: ref #1185560
2019-01-16 10:56:41 [DEBUG   ] summary = ERROR
2019-01-16 10:56:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185560  13 58499 39401753 A  ERRORERROR'
2019-01-16 10:56:41 [DEBUG   ] Got command RPT from MCS: ref #1185561
2019-01-16 10:56:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:56:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185561  77 58499 39401945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:56:42 [DEBUG   ] Got command RPT from MCS: ref #1185562
2019-01-16 10:56:42 [DEBUG   ] summary = ERROR
2019-01-16 10:56:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185562  13 58499 39402149 A  ERRORERROR'
2019-01-16 10:56:42 [DEBUG   ] Got command RPT from MCS: ref #1185564
2019-01-16 10:56:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 10:56:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185564  77 58499 39402353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 10:56:42 [DEBUG   ] Got command RPT from MCS: ref #1185566
2019-01-16 10:56:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 10:56:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185566  12 58499 39402557 A  ERRORB¢ff'
2019-01-16 10:56:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:56:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-16 10:56:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 10:56:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:56:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 10:56:53 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 10:56:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:56:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:56:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:56:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:56:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:56:53 [DEBUG   ] Finished updating board flags in 1.271 seconds
2019-01-16 10:56:54 [DEBUG   ] Got command BAM from MCS: ref #1185575
2019-01-16 10:56:54 [INFO    ] Finished processing BAM request
2019-01-16 10:56:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:56:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185575   8 58499 39414033 A  ERROR'
2019-01-16 10:56:54 [DEBUG   ] Got command BAM from MCS: ref #1185574
2019-01-16 10:56:54 [INFO    ] Finished processing BAM request
2019-01-16 10:56:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:56:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185574   8 58499 39414037 A  ERROR'
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 10:56:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 10:56:54 [DEBUG   ] spawn_process: at 2019-01-16 10:56:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 10:57:10 [DEBUG   ] Got command BAM from MCS: ref #1185576
2019-01-16 10:57:10 [INFO    ] Finished processing BAM request
2019-01-16 10:57:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:57:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185576   8 58499 39430025 A  ERROR'
2019-01-16 10:57:10 [DEBUG   ] Got command BAM from MCS: ref #1185577
2019-01-16 10:57:10 [INFO    ] Finished processing BAM request
2019-01-16 10:57:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:57:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185577   8 58499 39430029 A  ERROR'
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 10:57:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 10:57:10 [DEBUG   ] spawn_process: at 2019-01-16 10:57:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 10:57:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 10:57:26 [DEBUG   ] Got command BAM from MCS: ref #1185578
2019-01-16 10:57:26 [INFO    ] Finished processing BAM request
2019-01-16 10:57:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:57:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185578   8 58499 39446029 A  ERROR'
2019-01-16 10:57:26 [DEBUG   ] Got command BAM from MCS: ref #1185579
2019-01-16 10:57:26 [INFO    ] Finished processing BAM request
2019-01-16 10:57:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:57:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185579   8 58499 39446033 A  ERROR'
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 10:57:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 10:57:26 [DEBUG   ] spawn_process: at 2019-01-16 10:57:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 10:57:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:57:42 [DEBUG   ] Got command BAM from MCS: ref #1185580
2019-01-16 10:57:42 [INFO    ] Finished processing BAM request
2019-01-16 10:57:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:57:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185580   8 58499 39462025 A  ERROR'
2019-01-16 10:57:42 [DEBUG   ] Got command BAM from MCS: ref #1185581
2019-01-16 10:57:42 [INFO    ] Finished processing BAM request
2019-01-16 10:57:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:57:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185581   8 58499 39462029 A  ERROR'
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 10:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 10:57:42 [DEBUG   ] spawn_process: at 2019-01-16 10:57:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 10:57:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:57:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 10:57:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-16 10:57:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:57:53 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 10:57:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:57:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:57:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:57:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:57:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:57:53 [DEBUG   ] Finished updating board flags in 1.117 seconds
2019-01-16 10:57:58 [DEBUG   ] Got command BAM from MCS: ref #1185583
2019-01-16 10:57:58 [INFO    ] Finished processing BAM request
2019-01-16 10:57:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:57:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185583   8 58499 39478025 A  ERROR'
2019-01-16 10:57:58 [DEBUG   ] Got command BAM from MCS: ref #1185582
2019-01-16 10:57:58 [INFO    ] Finished processing BAM request
2019-01-16 10:57:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:57:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185582   8 58499 39478029 A  ERROR'
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 10:57:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 10:57:58 [DEBUG   ] spawn_process: at 2019-01-16 10:57:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 10:58:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:58:14 [DEBUG   ] Got command BAM from MCS: ref #1185585
2019-01-16 10:58:14 [INFO    ] Finished processing BAM request
2019-01-16 10:58:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:58:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185585   8 58499 39494029 A  ERROR'
2019-01-16 10:58:14 [DEBUG   ] Got command BAM from MCS: ref #1185584
2019-01-16 10:58:14 [INFO    ] Finished processing BAM request
2019-01-16 10:58:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:58:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185584   8 58499 39494033 A  ERROR'
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 10:58:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 10:58:14 [DEBUG   ] spawn_process: at 2019-01-16 10:58:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 10:58:30 [DEBUG   ] Got command BAM from MCS: ref #1185587
2019-01-16 10:58:30 [INFO    ] Finished processing BAM request
2019-01-16 10:58:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:58:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185587   8 58499 39510033 A  ERROR'
2019-01-16 10:58:30 [DEBUG   ] Got command BAM from MCS: ref #1185586
2019-01-16 10:58:30 [INFO    ] Finished processing BAM request
2019-01-16 10:58:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:58:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185586   8 58499 39510037 A  ERROR'
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 10:58:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 10:58:30 [DEBUG   ] spawn_process: at 2019-01-16 10:58:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 10:58:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:58:46 [DEBUG   ] Got command BAM from MCS: ref #1185588
2019-01-16 10:58:46 [INFO    ] Finished processing BAM request
2019-01-16 10:58:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:58:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185588   8 58499 39526025 A  ERROR'
2019-01-16 10:58:46 [DEBUG   ] Got command BAM from MCS: ref #1185589
2019-01-16 10:58:46 [INFO    ] Finished processing BAM request
2019-01-16 10:58:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:58:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185589   8 58499 39526029 A  ERROR'
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 10:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 10:58:46 [DEBUG   ] spawn_process: at 2019-01-16 10:58:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 10:58:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:58:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-16 10:58:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:58:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-01-16 10:58:53 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 10:58:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:58:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:58:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:58:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:58:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:58:53 [DEBUG   ] Finished updating board flags in 1.011 seconds
2019-01-16 10:59:02 [DEBUG   ] Got command BAM from MCS: ref #1185591
2019-01-16 10:59:02 [INFO    ] Finished processing BAM request
2019-01-16 10:59:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:59:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185591   8 58499 39542029 A  ERROR'
2019-01-16 10:59:02 [DEBUG   ] Got command BAM from MCS: ref #1185590
2019-01-16 10:59:02 [INFO    ] Finished processing BAM request
2019-01-16 10:59:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:59:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185590   8 58499 39542033 A  ERROR'
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 10:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 10:59:02 [DEBUG   ] spawn_process: at 2019-01-16 10:59:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 10:59:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:59:18 [DEBUG   ] Got command BAM from MCS: ref #1185592
2019-01-16 10:59:18 [INFO    ] Finished processing BAM request
2019-01-16 10:59:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:59:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185592   8 58499 39558025 A  ERROR'
2019-01-16 10:59:18 [DEBUG   ] Got command BAM from MCS: ref #1185593
2019-01-16 10:59:18 [INFO    ] Finished processing BAM request
2019-01-16 10:59:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:59:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185593   8 58499 39558029 A  ERROR'
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 10:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 10:59:18 [DEBUG   ] spawn_process: at 2019-01-16 10:59:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 10:59:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:59:34 [DEBUG   ] Got command BAM from MCS: ref #1185595
2019-01-16 10:59:34 [INFO    ] Finished processing BAM request
2019-01-16 10:59:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:59:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185595   8 58499 39574025 A  ERROR'
2019-01-16 10:59:34 [DEBUG   ] Got command BAM from MCS: ref #1185594
2019-01-16 10:59:34 [INFO    ] Finished processing BAM request
2019-01-16 10:59:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:59:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185594   8 58499 39574029 A  ERROR'
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 10:59:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 10:59:34 [DEBUG   ] spawn_process: at 2019-01-16 10:59:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 10:59:50 [DEBUG   ] Got command BAM from MCS: ref #1185600
2019-01-16 10:59:50 [INFO    ] Finished processing BAM request
2019-01-16 10:59:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:59:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185600   8 58499 39590033 A  ERROR'
2019-01-16 10:59:50 [DEBUG   ] Got command BAM from MCS: ref #1185601
2019-01-16 10:59:50 [INFO    ] Finished processing BAM request
2019-01-16 10:59:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 10:59:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185601   8 58499 39590037 A  ERROR'
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 10:59:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 10:59:50 [DEBUG   ] spawn_process: at 2019-01-16 10:59:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 10:59:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 10:59:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 10:59:53 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 10:59:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 10:59:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:59:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:59:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:59:53 [WARNING ] (13, 1, 'bot')
2019-01-16 10:59:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 10:59:53 [DEBUG   ] Finished updating board flags in 1.011 seconds
2019-01-16 11:00:06 [DEBUG   ] Got command BAM from MCS: ref #1185602
2019-01-16 11:00:06 [INFO    ] Finished processing BAM request
2019-01-16 11:00:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:00:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185602   8 58499 39606033 A  ERROR'
2019-01-16 11:00:06 [DEBUG   ] Got command BAM from MCS: ref #1185603
2019-01-16 11:00:06 [INFO    ] Finished processing BAM request
2019-01-16 11:00:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:00:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185603   8 58499 39606037 A  ERROR'
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 11:00:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 11:00:06 [DEBUG   ] spawn_process: at 2019-01-16 11:00:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 11:00:11 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-16 11:00:22 [DEBUG   ] Got command BAM from MCS: ref #1185605
2019-01-16 11:00:22 [INFO    ] Finished processing BAM request
2019-01-16 11:00:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:00:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185605   8 58499 39622037 A  ERROR'
2019-01-16 11:00:22 [DEBUG   ] Got command BAM from MCS: ref #1185604
2019-01-16 11:00:22 [INFO    ] Finished processing BAM request
2019-01-16 11:00:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:00:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185604   8 58499 39622041 A  ERROR'
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 11:00:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 11:00:22 [DEBUG   ] spawn_process: at 2019-01-16 11:00:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 11:00:31 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-16 11:00:38 [DEBUG   ] Got command BAM from MCS: ref #1185606
2019-01-16 11:00:38 [INFO    ] Finished processing BAM request
2019-01-16 11:00:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:00:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185606   8 58499 39638025 A  ERROR'
2019-01-16 11:00:38 [DEBUG   ] Got command BAM from MCS: ref #1185607
2019-01-16 11:00:38 [INFO    ] Finished processing BAM request
2019-01-16 11:00:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:00:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185607   8 58499 39638029 A  ERROR'
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 11:00:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 11:00:38 [DEBUG   ] spawn_process: at 2019-01-16 11:00:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 11:00:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:00:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 11:00:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:00:53 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 11:00:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 11:00:53 [WARNING ] (13, 1, 'bot')
2019-01-16 11:00:53 [WARNING ] (13, 1, 'bot')
2019-01-16 11:00:53 [WARNING ] (13, 1, 'bot')
2019-01-16 11:00:53 [WARNING ] (13, 1, 'bot')
2019-01-16 11:00:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:00:53 [DEBUG   ] Finished updating board flags in 0.983 seconds
2019-01-16 11:00:54 [DEBUG   ] Got command BAM from MCS: ref #1185609
2019-01-16 11:00:54 [INFO    ] Finished processing BAM request
2019-01-16 11:00:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185609   8 58499 39654033 A  ERROR'
2019-01-16 11:00:54 [DEBUG   ] Got command BAM from MCS: ref #1185608
2019-01-16 11:00:54 [INFO    ] Finished processing BAM request
2019-01-16 11:00:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185608   8 58499 39654037 A  ERROR'
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 11:00:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 11:00:54 [DEBUG   ] spawn_process: at 2019-01-16 11:00:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 11:01:05 [DEBUG   ] Got command RPT from MCS: ref #1185610
2019-01-16 11:01:05 [DEBUG   ] summary = ERROR
2019-01-16 11:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185610  13 58499 39665305 A  ERRORERROR'
2019-01-16 11:01:05 [DEBUG   ] Got command RPT from MCS: ref #1185611
2019-01-16 11:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185611  77 58499 39665306 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:01:10 [DEBUG   ] Got command BAM from MCS: ref #1185628
2019-01-16 11:01:10 [INFO    ] Finished processing BAM request
2019-01-16 11:01:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:01:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185628   8 58499 39670025 A  ERROR'
2019-01-16 11:01:10 [DEBUG   ] Got command BAM from MCS: ref #1185627
2019-01-16 11:01:10 [INFO    ] Finished processing BAM request
2019-01-16 11:01:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:01:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185627   8 58499 39670029 A  ERROR'
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 11:01:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 11:01:10 [DEBUG   ] spawn_process: at 2019-01-16 11:01:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 11:01:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:01:26 [DEBUG   ] Got command BAM from MCS: ref #1185630
2019-01-16 11:01:26 [INFO    ] Finished processing BAM request
2019-01-16 11:01:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:01:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185630   8 58499 39686033 A  ERROR'
2019-01-16 11:01:26 [DEBUG   ] Got command BAM from MCS: ref #1185629
2019-01-16 11:01:26 [INFO    ] Finished processing BAM request
2019-01-16 11:01:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:01:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185629   8 58499 39686037 A  ERROR'
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 11:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 11:01:26 [DEBUG   ] spawn_process: at 2019-01-16 11:01:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 11:01:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:01:41 [DEBUG   ] Got command RPT from MCS: ref #1185633
2019-01-16 11:01:41 [DEBUG   ] summary = ERROR
2019-01-16 11:01:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185633  13 58499 39701833 A  ERRORERROR'
2019-01-16 11:01:42 [DEBUG   ] Got command BAM from MCS: ref #1185631
2019-01-16 11:01:42 [INFO    ] Finished processing BAM request
2019-01-16 11:01:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:01:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185631   8 58499 39702029 A  ERROR'
2019-01-16 11:01:42 [DEBUG   ] Got command BAM from MCS: ref #1185632
2019-01-16 11:01:42 [INFO    ] Finished processing BAM request
2019-01-16 11:01:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:01:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185632   8 58499 39702033 A  ERROR'
2019-01-16 11:01:42 [DEBUG   ] Got command RPT from MCS: ref #1185634
2019-01-16 11:01:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:01:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185634  77 58499 39702033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:01:42 [DEBUG   ] Got command RPT from MCS: ref #1185635
2019-01-16 11:01:42 [DEBUG   ] summary = ERROR
2019-01-16 11:01:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185635  13 58499 39702237 A  ERRORERROR'
2019-01-16 11:01:42 [DEBUG   ] Got command RPT from MCS: ref #1185636
2019-01-16 11:01:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:01:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185636  77 58499 39702441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:01:42 [DEBUG   ] Got command RPT from MCS: ref #1185637
2019-01-16 11:01:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 11:01:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185637  12 58499 39702645 A  ERRORB£ff'
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 11:01:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 11:01:42 [DEBUG   ] spawn_process: at 2019-01-16 11:01:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 11:01:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:01:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-01-16 11:01:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:01:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 11:01:54 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 11:01:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:01:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:01:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:01:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:01:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:01:54 [DEBUG   ] Finished updating board flags in 1.366 seconds
2019-01-16 11:01:58 [DEBUG   ] Got command BAM from MCS: ref #1185639
2019-01-16 11:01:58 [INFO    ] Finished processing BAM request
2019-01-16 11:01:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:01:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185639   8 58499 39718025 A  ERROR'
2019-01-16 11:01:58 [DEBUG   ] Got command BAM from MCS: ref #1185638
2019-01-16 11:01:58 [INFO    ] Finished processing BAM request
2019-01-16 11:01:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:01:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185638   8 58499 39718029 A  ERROR'
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 11:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 11:01:58 [DEBUG   ] spawn_process: at 2019-01-16 11:01:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 11:02:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:02:14 [DEBUG   ] Got command BAM from MCS: ref #1185641
2019-01-16 11:02:14 [INFO    ] Finished processing BAM request
2019-01-16 11:02:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:02:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185641   8 58499 39734029 A  ERROR'
2019-01-16 11:02:14 [DEBUG   ] Got command BAM from MCS: ref #1185640
2019-01-16 11:02:14 [INFO    ] Finished processing BAM request
2019-01-16 11:02:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:02:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185640   8 58499 39734033 A  ERROR'
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 11:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 11:02:14 [DEBUG   ] spawn_process: at 2019-01-16 11:02:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 11:02:30 [DEBUG   ] Got command BAM from MCS: ref #1185642
2019-01-16 11:02:30 [INFO    ] Finished processing BAM request
2019-01-16 11:02:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:02:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185642   8 58499 39750033 A  ERROR'
2019-01-16 11:02:30 [DEBUG   ] Got command BAM from MCS: ref #1185643
2019-01-16 11:02:30 [INFO    ] Finished processing BAM request
2019-01-16 11:02:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:02:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185643   8 58499 39750037 A  ERROR'
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 11:02:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 11:02:30 [DEBUG   ] spawn_process: at 2019-01-16 11:02:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 11:02:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:02:46 [DEBUG   ] Got command BAM from MCS: ref #1185644
2019-01-16 11:02:46 [INFO    ] Finished processing BAM request
2019-01-16 11:02:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:02:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185644   8 58499 39766033 A  ERROR'
2019-01-16 11:02:46 [DEBUG   ] Got command BAM from MCS: ref #1185645
2019-01-16 11:02:46 [INFO    ] Finished processing BAM request
2019-01-16 11:02:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:02:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185645   8 58499 39766037 A  ERROR'
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 11:02:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 11:02:46 [DEBUG   ] spawn_process: at 2019-01-16 11:02:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 11:02:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:02:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-16 11:02:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:02:54 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 11:02:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:02:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:02:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:02:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:02:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:02:54 [DEBUG   ] Finished updating board flags in 1.199 seconds
2019-01-16 11:03:02 [DEBUG   ] Got command BAM from MCS: ref #1185651
2019-01-16 11:03:02 [INFO    ] Finished processing BAM request
2019-01-16 11:03:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:03:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185651   8 58499 39782025 A  ERROR'
2019-01-16 11:03:02 [DEBUG   ] Got command BAM from MCS: ref #1185650
2019-01-16 11:03:02 [INFO    ] Finished processing BAM request
2019-01-16 11:03:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:03:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185650   8 58499 39782029 A  ERROR'
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 11:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 11:03:02 [DEBUG   ] spawn_process: at 2019-01-16 11:03:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 11:03:12 [DEBUG   ] Finished updating ant stats in 1.802 seconds
2019-01-16 11:03:18 [DEBUG   ] Got command BAM from MCS: ref #1185652
2019-01-16 11:03:18 [INFO    ] Finished processing BAM request
2019-01-16 11:03:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:03:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185652   8 58499 39798029 A  ERROR'
2019-01-16 11:03:18 [DEBUG   ] Got command BAM from MCS: ref #1185653
2019-01-16 11:03:18 [INFO    ] Finished processing BAM request
2019-01-16 11:03:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:03:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185653   8 58499 39798033 A  ERROR'
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 11:03:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 11:03:18 [DEBUG   ] spawn_process: at 2019-01-16 11:03:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 11:03:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:03:34 [DEBUG   ] Got command BAM from MCS: ref #1185655
2019-01-16 11:03:34 [INFO    ] Finished processing BAM request
2019-01-16 11:03:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:03:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185655   8 58499 39814029 A  ERROR'
2019-01-16 11:03:34 [DEBUG   ] Got command BAM from MCS: ref #1185654
2019-01-16 11:03:34 [INFO    ] Finished processing BAM request
2019-01-16 11:03:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:03:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185654   8 58499 39814033 A  ERROR'
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 11:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 11:03:34 [DEBUG   ] spawn_process: at 2019-01-16 11:03:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 11:03:50 [DEBUG   ] Got command BAM from MCS: ref #1185657
2019-01-16 11:03:50 [INFO    ] Finished processing BAM request
2019-01-16 11:03:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:03:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185657   8 58499 39830025 A  ERROR'
2019-01-16 11:03:50 [DEBUG   ] Got command BAM from MCS: ref #1185656
2019-01-16 11:03:50 [INFO    ] Finished processing BAM request
2019-01-16 11:03:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:03:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185656   8 58499 39830029 A  ERROR'
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 11:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 11:03:50 [DEBUG   ] spawn_process: at 2019-01-16 11:03:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 11:03:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:03:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 11:03:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:03:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 11:03:54 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 11:03:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:03:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:03:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:03:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:03:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:03:54 [DEBUG   ] Finished updating board flags in 1.011 seconds
2019-01-16 11:04:06 [DEBUG   ] Got command BAM from MCS: ref #1185659
2019-01-16 11:04:06 [INFO    ] Finished processing BAM request
2019-01-16 11:04:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185659   8 58499 39846033 A  ERROR'
2019-01-16 11:04:06 [DEBUG   ] Got command BAM from MCS: ref #1185658
2019-01-16 11:04:06 [INFO    ] Finished processing BAM request
2019-01-16 11:04:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185658   8 58499 39846037 A  ERROR'
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 11:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 11:04:06 [DEBUG   ] spawn_process: at 2019-01-16 11:04:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 11:04:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:04:22 [DEBUG   ] Got command BAM from MCS: ref #1185660
2019-01-16 11:04:22 [INFO    ] Finished processing BAM request
2019-01-16 11:04:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:04:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185660   8 58499 39862025 A  ERROR'
2019-01-16 11:04:22 [DEBUG   ] Got command BAM from MCS: ref #1185661
2019-01-16 11:04:22 [INFO    ] Finished processing BAM request
2019-01-16 11:04:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:04:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185661   8 58499 39862029 A  ERROR'
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 11:04:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 11:04:22 [DEBUG   ] spawn_process: at 2019-01-16 11:04:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 11:04:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:04:38 [DEBUG   ] Got command BAM from MCS: ref #1185662
2019-01-16 11:04:38 [INFO    ] Finished processing BAM request
2019-01-16 11:04:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:04:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185662   8 58499 39878025 A  ERROR'
2019-01-16 11:04:38 [DEBUG   ] Got command BAM from MCS: ref #1185663
2019-01-16 11:04:38 [INFO    ] Finished processing BAM request
2019-01-16 11:04:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:04:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185663   8 58499 39878029 A  ERROR'
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 11:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 11:04:38 [DEBUG   ] spawn_process: at 2019-01-16 11:04:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 11:04:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:04:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 11:04:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:04:54 [DEBUG   ] Got command BAM from MCS: ref #1185664
2019-01-16 11:04:54 [INFO    ] Finished processing BAM request
2019-01-16 11:04:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:04:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185664   8 58499 39894033 A  ERROR'
2019-01-16 11:04:54 [DEBUG   ] Got command BAM from MCS: ref #1185665
2019-01-16 11:04:54 [INFO    ] Finished processing BAM request
2019-01-16 11:04:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:04:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185665   8 58499 39894037 A  ERROR'
2019-01-16 11:04:54 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 11:04:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 11:04:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:04:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:04:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:04:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:04:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:04:54 [DEBUG   ] Finished updating board flags in 1.032 seconds
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 11:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 11:04:54 [DEBUG   ] spawn_process: at 2019-01-16 11:04:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 11:05:10 [DEBUG   ] Got command BAM from MCS: ref #1185666
2019-01-16 11:05:10 [INFO    ] Finished processing BAM request
2019-01-16 11:05:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:05:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185666   8 58499 39910025 A  ERROR'
2019-01-16 11:05:10 [DEBUG   ] Got command BAM from MCS: ref #1185667
2019-01-16 11:05:10 [INFO    ] Finished processing BAM request
2019-01-16 11:05:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:05:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185667   8 58499 39910029 A  ERROR'
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 11:05:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 11:05:10 [DEBUG   ] spawn_process: at 2019-01-16 11:05:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 11:05:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:05:26 [DEBUG   ] Got command BAM from MCS: ref #1185669
2019-01-16 11:05:26 [INFO    ] Finished processing BAM request
2019-01-16 11:05:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:05:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185669   8 58499 39926033 A  ERROR'
2019-01-16 11:05:26 [DEBUG   ] Got command BAM from MCS: ref #1185668
2019-01-16 11:05:26 [INFO    ] Finished processing BAM request
2019-01-16 11:05:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:05:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185668   8 58499 39926037 A  ERROR'
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 11:05:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 11:05:26 [DEBUG   ] spawn_process: at 2019-01-16 11:05:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 11:05:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:05:42 [DEBUG   ] Got command BAM from MCS: ref #1185670
2019-01-16 11:05:42 [INFO    ] Finished processing BAM request
2019-01-16 11:05:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:05:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185670   8 58499 39942033 A  ERROR'
2019-01-16 11:05:42 [DEBUG   ] Got command BAM from MCS: ref #1185671
2019-01-16 11:05:42 [INFO    ] Finished processing BAM request
2019-01-16 11:05:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:05:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185671   8 58499 39942037 A  ERROR'
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 11:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 11:05:42 [DEBUG   ] spawn_process: at 2019-01-16 11:05:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 11:05:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:05:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:05:54 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 11:05:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 11:05:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:05:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:05:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:05:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:05:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:05:54 [DEBUG   ] Finished updating board flags in 1.439 seconds
2019-01-16 11:05:58 [DEBUG   ] Got command BAM from MCS: ref #1185677
2019-01-16 11:05:58 [INFO    ] Finished processing BAM request
2019-01-16 11:05:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185677   8 58499 39958033 A  ERROR'
2019-01-16 11:05:58 [DEBUG   ] Got command BAM from MCS: ref #1185676
2019-01-16 11:05:58 [INFO    ] Finished processing BAM request
2019-01-16 11:05:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185676   8 58499 39958037 A  ERROR'
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 11:05:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 11:05:58 [DEBUG   ] spawn_process: at 2019-01-16 11:05:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 11:06:05 [DEBUG   ] Got command RPT from MCS: ref #1185678
2019-01-16 11:06:05 [DEBUG   ] summary = ERROR
2019-01-16 11:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185678  13 58499 39965301 A  ERRORERROR'
2019-01-16 11:06:05 [DEBUG   ] Got command RPT from MCS: ref #1185679
2019-01-16 11:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185679  77 58499 39965302 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:06:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:06:14 [DEBUG   ] Got command BAM from MCS: ref #1185696
2019-01-16 11:06:14 [INFO    ] Finished processing BAM request
2019-01-16 11:06:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:06:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185696   8 58499 39974033 A  ERROR'
2019-01-16 11:06:14 [DEBUG   ] Got command BAM from MCS: ref #1185695
2019-01-16 11:06:14 [INFO    ] Finished processing BAM request
2019-01-16 11:06:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:06:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185695   8 58499 39974037 A  ERROR'
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 11:06:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 11:06:14 [DEBUG   ] spawn_process: at 2019-01-16 11:06:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 11:06:30 [DEBUG   ] Got command BAM from MCS: ref #1185698
2019-01-16 11:06:30 [INFO    ] Finished processing BAM request
2019-01-16 11:06:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:06:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185698   8 58499 39990025 A  ERROR'
2019-01-16 11:06:30 [DEBUG   ] Got command BAM from MCS: ref #1185697
2019-01-16 11:06:30 [INFO    ] Finished processing BAM request
2019-01-16 11:06:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:06:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185697   8 58499 39990029 A  ERROR'
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 11:06:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 11:06:30 [DEBUG   ] spawn_process: at 2019-01-16 11:06:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 11:06:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:06:41 [DEBUG   ] Got command RPT from MCS: ref #1185701
2019-01-16 11:06:41 [DEBUG   ] summary = ERROR
2019-01-16 11:06:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185701  13 58499 40001925 A  ERRORERROR'
2019-01-16 11:06:42 [DEBUG   ] Got command RPT from MCS: ref #1185702
2019-01-16 11:06:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:06:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185702  77 58499 40002117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:06:42 [DEBUG   ] Got command RPT from MCS: ref #1185703
2019-01-16 11:06:42 [DEBUG   ] summary = ERROR
2019-01-16 11:06:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185703  13 58499 40002321 A  ERRORERROR'
2019-01-16 11:06:42 [DEBUG   ] Got command RPT from MCS: ref #1185705
2019-01-16 11:06:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:06:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185705  77 58499 40002525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:06:42 [DEBUG   ] Got command RPT from MCS: ref #1185707
2019-01-16 11:06:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 11:06:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185707  12 58499 40002717 A  ERRORB¢ff'
2019-01-16 11:06:46 [DEBUG   ] Got command BAM from MCS: ref #1185712
2019-01-16 11:06:46 [INFO    ] Finished processing BAM request
2019-01-16 11:06:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:06:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185712   8 58499 40006033 A  ERROR'
2019-01-16 11:06:46 [DEBUG   ] Got command BAM from MCS: ref #1185711
2019-01-16 11:06:46 [INFO    ] Finished processing BAM request
2019-01-16 11:06:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:06:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185711   8 58499 40006037 A  ERROR'
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 11:06:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 11:06:46 [DEBUG   ] spawn_process: at 2019-01-16 11:06:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 11:06:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:06:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-16 11:06:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-16 11:06:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:06:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-16 11:06:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 11:06:54 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 11:06:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:06:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:06:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:06:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:06:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:06:54 [DEBUG   ] Finished updating board flags in 1.377 seconds
2019-01-16 11:07:02 [DEBUG   ] Got command BAM from MCS: ref #1185713
2019-01-16 11:07:02 [INFO    ] Finished processing BAM request
2019-01-16 11:07:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:07:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185713   8 58499 40022053 A  ERROR'
2019-01-16 11:07:02 [DEBUG   ] Got command BAM from MCS: ref #1185714
2019-01-16 11:07:02 [INFO    ] Finished processing BAM request
2019-01-16 11:07:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:07:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185714   8 58499 40022057 A  ERROR'
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 11:07:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 11:07:02 [DEBUG   ] spawn_process: at 2019-01-16 11:07:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 11:07:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:07:18 [DEBUG   ] Got command BAM from MCS: ref #1185715
2019-01-16 11:07:18 [INFO    ] Finished processing BAM request
2019-01-16 11:07:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:07:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185715   8 58499 40038029 A  ERROR'
2019-01-16 11:07:18 [DEBUG   ] Got command BAM from MCS: ref #1185716
2019-01-16 11:07:18 [INFO    ] Finished processing BAM request
2019-01-16 11:07:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:07:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185716   8 58499 40038033 A  ERROR'
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 11:07:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 11:07:18 [DEBUG   ] spawn_process: at 2019-01-16 11:07:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 11:07:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:07:34 [DEBUG   ] Got command BAM from MCS: ref #1185717
2019-01-16 11:07:34 [INFO    ] Finished processing BAM request
2019-01-16 11:07:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:07:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185717   8 58499 40054033 A  ERROR'
2019-01-16 11:07:34 [DEBUG   ] Got command BAM from MCS: ref #1185718
2019-01-16 11:07:34 [INFO    ] Finished processing BAM request
2019-01-16 11:07:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:07:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185718   8 58499 40054037 A  ERROR'
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 11:07:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 11:07:34 [DEBUG   ] spawn_process: at 2019-01-16 11:07:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 11:07:50 [DEBUG   ] Got command BAM from MCS: ref #1185720
2019-01-16 11:07:50 [INFO    ] Finished processing BAM request
2019-01-16 11:07:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:07:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185720   8 58499 40070025 A  ERROR'
2019-01-16 11:07:50 [DEBUG   ] Got command BAM from MCS: ref #1185719
2019-01-16 11:07:50 [INFO    ] Finished processing BAM request
2019-01-16 11:07:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:07:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185719   8 58499 40070029 A  ERROR'
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 11:07:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 11:07:50 [DEBUG   ] spawn_process: at 2019-01-16 11:07:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 11:07:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:07:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-16 11:07:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 11:07:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2019-01-16 11:07:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 11:07:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:07:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 11:07:54 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 11:07:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 11:07:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:07:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:07:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:07:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:07:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:07:54 [DEBUG   ] Finished updating board flags in 1.209 seconds
2019-01-16 11:08:06 [DEBUG   ] Got command BAM from MCS: ref #1185721
2019-01-16 11:08:06 [INFO    ] Finished processing BAM request
2019-01-16 11:08:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:08:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185721   8 58499 40086029 A  ERROR'
2019-01-16 11:08:06 [DEBUG   ] Got command BAM from MCS: ref #1185722
2019-01-16 11:08:06 [INFO    ] Finished processing BAM request
2019-01-16 11:08:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:08:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185722   8 58499 40086033 A  ERROR'
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 11:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 11:08:06 [DEBUG   ] spawn_process: at 2019-01-16 11:08:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 11:08:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:08:22 [DEBUG   ] Got command BAM from MCS: ref #1185723
2019-01-16 11:08:22 [INFO    ] Finished processing BAM request
2019-01-16 11:08:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185723   8 58499 40102025 A  ERROR'
2019-01-16 11:08:22 [DEBUG   ] Got command BAM from MCS: ref #1185724
2019-01-16 11:08:22 [INFO    ] Finished processing BAM request
2019-01-16 11:08:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185724   8 58499 40102029 A  ERROR'
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 11:08:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 11:08:22 [DEBUG   ] spawn_process: at 2019-01-16 11:08:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 11:08:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:08:38 [DEBUG   ] Got command BAM from MCS: ref #1185725
2019-01-16 11:08:38 [INFO    ] Finished processing BAM request
2019-01-16 11:08:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:08:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185725   8 58499 40118029 A  ERROR'
2019-01-16 11:08:38 [DEBUG   ] Got command BAM from MCS: ref #1185726
2019-01-16 11:08:38 [INFO    ] Finished processing BAM request
2019-01-16 11:08:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:08:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185726   8 58499 40118033 A  ERROR'
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 11:08:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 11:08:38 [DEBUG   ] spawn_process: at 2019-01-16 11:08:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 11:08:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:08:54 [DEBUG   ] Got command BAM from MCS: ref #1185732
2019-01-16 11:08:54 [INFO    ] Finished processing BAM request
2019-01-16 11:08:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:08:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185732   8 58499 40134033 A  ERROR'
2019-01-16 11:08:54 [DEBUG   ] Got command BAM from MCS: ref #1185731
2019-01-16 11:08:54 [INFO    ] Finished processing BAM request
2019-01-16 11:08:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:08:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185731   8 58499 40134041 A  ERROR'
2019-01-16 11:08:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-01-16 11:08:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 11:08:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 11:08:54 [DEBUG   ] spawn_process: at 2019-01-16 11:08:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 11:08:55 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 11:08:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:08:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:08:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:08:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:08:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:08:55 [DEBUG   ] Finished updating board flags in 1.747 seconds
2019-01-16 11:09:10 [DEBUG   ] Got command BAM from MCS: ref #1185733
2019-01-16 11:09:10 [INFO    ] Finished processing BAM request
2019-01-16 11:09:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:09:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185733   8 58499 40150025 A  ERROR'
2019-01-16 11:09:10 [DEBUG   ] Got command BAM from MCS: ref #1185734
2019-01-16 11:09:10 [INFO    ] Finished processing BAM request
2019-01-16 11:09:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:09:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185734   8 58499 40150029 A  ERROR'
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 11:09:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 11:09:10 [DEBUG   ] spawn_process: at 2019-01-16 11:09:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 11:09:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:09:26 [DEBUG   ] Got command BAM from MCS: ref #1185736
2019-01-16 11:09:26 [INFO    ] Finished processing BAM request
2019-01-16 11:09:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:09:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185736   8 58499 40166029 A  ERROR'
2019-01-16 11:09:26 [DEBUG   ] Got command BAM from MCS: ref #1185735
2019-01-16 11:09:26 [INFO    ] Finished processing BAM request
2019-01-16 11:09:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:09:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185735   8 58499 40166033 A  ERROR'
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 11:09:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 11:09:26 [DEBUG   ] spawn_process: at 2019-01-16 11:09:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 11:09:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:09:42 [DEBUG   ] Got command BAM from MCS: ref #1185738
2019-01-16 11:09:42 [INFO    ] Finished processing BAM request
2019-01-16 11:09:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:09:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185738   8 58499 40182033 A  ERROR'
2019-01-16 11:09:42 [DEBUG   ] Got command BAM from MCS: ref #1185737
2019-01-16 11:09:42 [INFO    ] Finished processing BAM request
2019-01-16 11:09:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:09:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185737   8 58499 40182037 A  ERROR'
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 11:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 11:09:42 [DEBUG   ] spawn_process: at 2019-01-16 11:09:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 11:09:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:09:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:09:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2019-01-16 11:09:54 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 11:09:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:09:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:09:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:09:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:09:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:09:54 [DEBUG   ] Finished updating board flags in 1.048 seconds
2019-01-16 11:09:58 [DEBUG   ] Got command BAM from MCS: ref #1185740
2019-01-16 11:09:58 [INFO    ] Finished processing BAM request
2019-01-16 11:09:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:09:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185740   8 58499 40198025 A  ERROR'
2019-01-16 11:09:58 [DEBUG   ] Got command BAM from MCS: ref #1185739
2019-01-16 11:09:58 [INFO    ] Finished processing BAM request
2019-01-16 11:09:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:09:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185739   8 58499 40198029 A  ERROR'
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 11:09:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 11:09:58 [DEBUG   ] spawn_process: at 2019-01-16 11:09:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 11:10:11 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-16 11:10:14 [DEBUG   ] Got command BAM from MCS: ref #1185741
2019-01-16 11:10:14 [INFO    ] Finished processing BAM request
2019-01-16 11:10:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:10:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185741   8 58499 40214029 A  ERROR'
2019-01-16 11:10:14 [DEBUG   ] Got command BAM from MCS: ref #1185742
2019-01-16 11:10:14 [INFO    ] Finished processing BAM request
2019-01-16 11:10:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:10:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185742   8 58499 40214033 A  ERROR'
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 11:10:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 11:10:14 [DEBUG   ] spawn_process: at 2019-01-16 11:10:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 11:10:30 [DEBUG   ] Got command BAM from MCS: ref #1185743
2019-01-16 11:10:30 [INFO    ] Finished processing BAM request
2019-01-16 11:10:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:10:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185743   8 58499 40230029 A  ERROR'
2019-01-16 11:10:30 [DEBUG   ] Got command BAM from MCS: ref #1185744
2019-01-16 11:10:30 [INFO    ] Finished processing BAM request
2019-01-16 11:10:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:10:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185744   8 58499 40230033 A  ERROR'
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 11:10:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 11:10:30 [DEBUG   ] spawn_process: at 2019-01-16 11:10:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 11:10:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 11:10:46 [DEBUG   ] Got command BAM from MCS: ref #1185746
2019-01-16 11:10:46 [INFO    ] Finished processing BAM request
2019-01-16 11:10:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:10:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185746   8 58499 40246029 A  ERROR'
2019-01-16 11:10:46 [DEBUG   ] Got command BAM from MCS: ref #1185745
2019-01-16 11:10:46 [INFO    ] Finished processing BAM request
2019-01-16 11:10:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:10:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185745   8 58499 40246033 A  ERROR'
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 11:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 11:10:46 [DEBUG   ] spawn_process: at 2019-01-16 11:10:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 11:10:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 11:10:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 11:10:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:10:54 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 11:10:54 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-16 11:10:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:10:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:10:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:10:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:10:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:10:54 [DEBUG   ] Finished updating board flags in 1.013 seconds
2019-01-16 11:11:02 [DEBUG   ] Got command BAM from MCS: ref #1185748
2019-01-16 11:11:02 [INFO    ] Finished processing BAM request
2019-01-16 11:11:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:11:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185748   8 58499 40262033 A  ERROR'
2019-01-16 11:11:02 [DEBUG   ] Got command BAM from MCS: ref #1185747
2019-01-16 11:11:02 [INFO    ] Finished processing BAM request
2019-01-16 11:11:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:11:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185747   8 58499 40262037 A  ERROR'
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 11:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 11:11:02 [DEBUG   ] spawn_process: at 2019-01-16 11:11:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 11:11:05 [DEBUG   ] Got command RPT from MCS: ref #1185749
2019-01-16 11:11:05 [DEBUG   ] summary = ERROR
2019-01-16 11:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185749  13 58499 40265305 A  ERRORERROR'
2019-01-16 11:11:05 [DEBUG   ] Got command RPT from MCS: ref #1185750
2019-01-16 11:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185750  77 58499 40265306 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:11:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 11:11:18 [DEBUG   ] Got command BAM from MCS: ref #1185766
2019-01-16 11:11:18 [INFO    ] Finished processing BAM request
2019-01-16 11:11:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:11:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185766   8 58499 40278029 A  ERROR'
2019-01-16 11:11:18 [DEBUG   ] Got command BAM from MCS: ref #1185767
2019-01-16 11:11:18 [INFO    ] Finished processing BAM request
2019-01-16 11:11:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:11:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185767   8 58499 40278033 A  ERROR'
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 11:11:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 11:11:18 [DEBUG   ] spawn_process: at 2019-01-16 11:11:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 11:11:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 11:11:34 [DEBUG   ] Got command BAM from MCS: ref #1185768
2019-01-16 11:11:34 [INFO    ] Finished processing BAM request
2019-01-16 11:11:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:11:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185768   8 58499 40294025 A  ERROR'
2019-01-16 11:11:34 [DEBUG   ] Got command BAM from MCS: ref #1185769
2019-01-16 11:11:34 [INFO    ] Finished processing BAM request
2019-01-16 11:11:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:11:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185769   8 58499 40294029 A  ERROR'
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 11:11:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 11:11:34 [DEBUG   ] spawn_process: at 2019-01-16 11:11:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 11:11:42 [DEBUG   ] Got command RPT from MCS: ref #1185770
2019-01-16 11:11:42 [DEBUG   ] summary = ERROR
2019-01-16 11:11:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185770  13 58499 40302001 A  ERRORERROR'
2019-01-16 11:11:42 [DEBUG   ] Got command RPT from MCS: ref #1185771
2019-01-16 11:11:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:11:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185771  77 58499 40302205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:11:42 [DEBUG   ] Got command RPT from MCS: ref #1185772
2019-01-16 11:11:42 [DEBUG   ] summary = ERROR
2019-01-16 11:11:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185772  13 58499 40302409 A  ERRORERROR'
2019-01-16 11:11:42 [DEBUG   ] Got command RPT from MCS: ref #1185773
2019-01-16 11:11:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:11:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185773  77 58499 40302601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:11:42 [DEBUG   ] Got command RPT from MCS: ref #1185774
2019-01-16 11:11:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 11:11:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185774  12 58499 40302805 A  ERRORB£ff'
2019-01-16 11:11:50 [DEBUG   ] Got command BAM from MCS: ref #1185779
2019-01-16 11:11:50 [INFO    ] Finished processing BAM request
2019-01-16 11:11:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:11:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185779   8 58499 40310033 A  ERROR'
2019-01-16 11:11:50 [DEBUG   ] Got command BAM from MCS: ref #1185778
2019-01-16 11:11:50 [INFO    ] Finished processing BAM request
2019-01-16 11:11:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:11:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185778   8 58499 40310037 A  ERROR'
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 11:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 11:11:50 [DEBUG   ] spawn_process: at 2019-01-16 11:11:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 11:11:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 11:11:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-01-16 11:11:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:11:54 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 11:11:54 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-01-16 11:11:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:11:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:11:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:11:54 [WARNING ] (13, 1, 'bot')
2019-01-16 11:11:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:11:54 [DEBUG   ] Finished updating board flags in 0.975 seconds
2019-01-16 11:12:06 [DEBUG   ] Got command BAM from MCS: ref #1185781
2019-01-16 11:12:06 [INFO    ] Finished processing BAM request
2019-01-16 11:12:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:12:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185781   8 58499 40326025 A  ERROR'
2019-01-16 11:12:06 [DEBUG   ] Got command BAM from MCS: ref #1185782
2019-01-16 11:12:06 [INFO    ] Finished processing BAM request
2019-01-16 11:12:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:12:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185782   8 58499 40326029 A  ERROR'
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 11:12:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 11:12:06 [DEBUG   ] spawn_process: at 2019-01-16 11:12:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 11:12:11 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-16 11:12:22 [DEBUG   ] Got command BAM from MCS: ref #1185784
2019-01-16 11:12:22 [INFO    ] Finished processing BAM request
2019-01-16 11:12:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:12:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185784   8 58499 40342037 A  ERROR'
2019-01-16 11:12:22 [DEBUG   ] Got command BAM from MCS: ref #1185783
2019-01-16 11:12:22 [INFO    ] Finished processing BAM request
2019-01-16 11:12:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:12:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185783   8 58499 40342041 A  ERROR'
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 11:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 11:12:22 [DEBUG   ] spawn_process: at 2019-01-16 11:12:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 11:12:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 11:12:38 [DEBUG   ] Got command BAM from MCS: ref #1185785
2019-01-16 11:12:38 [INFO    ] Finished processing BAM request
2019-01-16 11:12:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:12:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185785   8 58499 40358025 A  ERROR'
2019-01-16 11:12:38 [DEBUG   ] Got command BAM from MCS: ref #1185786
2019-01-16 11:12:38 [INFO    ] Finished processing BAM request
2019-01-16 11:12:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:12:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185786   8 58499 40358029 A  ERROR'
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 11:12:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 11:12:38 [DEBUG   ] spawn_process: at 2019-01-16 11:12:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 11:12:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 11:12:54 [DEBUG   ] Got command BAM from MCS: ref #1185788
2019-01-16 11:12:54 [INFO    ] Finished processing BAM request
2019-01-16 11:12:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:12:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185788   8 58499 40374025 A  ERROR'
2019-01-16 11:12:54 [DEBUG   ] Got command BAM from MCS: ref #1185787
2019-01-16 11:12:54 [INFO    ] Finished processing BAM request
2019-01-16 11:12:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:12:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185787   8 58499 40374029 A  ERROR'
2019-01-16 11:12:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:12:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 11:12:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 11:12:54 [DEBUG   ] spawn_process: at 2019-01-16 11:12:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 11:12:55 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-16 11:12:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:12:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:12:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:12:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:12:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:12:55 [DEBUG   ] Finished updating board flags in 1.367 seconds
2019-01-16 11:13:10 [DEBUG   ] Got command BAM from MCS: ref #1185789
2019-01-16 11:13:10 [INFO    ] Finished processing BAM request
2019-01-16 11:13:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:13:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185789   8 58499 40390025 A  ERROR'
2019-01-16 11:13:10 [DEBUG   ] Got command BAM from MCS: ref #1185790
2019-01-16 11:13:10 [INFO    ] Finished processing BAM request
2019-01-16 11:13:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:13:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185790   8 58499 40390029 A  ERROR'
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 11:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 11:13:10 [DEBUG   ] spawn_process: at 2019-01-16 11:13:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 11:13:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 11:13:26 [DEBUG   ] Got command BAM from MCS: ref #1185792
2019-01-16 11:13:26 [INFO    ] Finished processing BAM request
2019-01-16 11:13:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185792   8 58499 40406029 A  ERROR'
2019-01-16 11:13:26 [DEBUG   ] Got command BAM from MCS: ref #1185791
2019-01-16 11:13:26 [INFO    ] Finished processing BAM request
2019-01-16 11:13:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185791   8 58499 40406033 A  ERROR'
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 11:13:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 11:13:26 [DEBUG   ] spawn_process: at 2019-01-16 11:13:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 11:13:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 11:13:42 [DEBUG   ] Got command BAM from MCS: ref #1185793
2019-01-16 11:13:42 [INFO    ] Finished processing BAM request
2019-01-16 11:13:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:13:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185793   8 58499 40422033 A  ERROR'
2019-01-16 11:13:42 [DEBUG   ] Got command BAM from MCS: ref #1185794
2019-01-16 11:13:42 [INFO    ] Finished processing BAM request
2019-01-16 11:13:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:13:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185794   8 58499 40422037 A  ERROR'
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 11:13:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 11:13:42 [DEBUG   ] spawn_process: at 2019-01-16 11:13:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 11:13:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 11:13:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-01-16 11:13:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:13:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-01-16 11:13:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 11:13:55 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-01-16 11:13:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 11:13:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:13:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:13:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:13:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:13:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:13:55 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-01-16 11:13:58 [DEBUG   ] Got command BAM from MCS: ref #1185795
2019-01-16 11:13:58 [INFO    ] Finished processing BAM request
2019-01-16 11:13:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:13:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185795   8 58499 40438033 A  ERROR'
2019-01-16 11:13:58 [DEBUG   ] Got command BAM from MCS: ref #1185796
2019-01-16 11:13:58 [INFO    ] Finished processing BAM request
2019-01-16 11:13:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:13:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185796   8 58499 40438037 A  ERROR'
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 11:13:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 11:13:58 [DEBUG   ] spawn_process: at 2019-01-16 11:13:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 11:14:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 11:14:14 [DEBUG   ] Got command BAM from MCS: ref #1185797
2019-01-16 11:14:14 [INFO    ] Finished processing BAM request
2019-01-16 11:14:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:14:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185797   8 58499 40454033 A  ERROR'
2019-01-16 11:14:14 [DEBUG   ] Got command BAM from MCS: ref #1185798
2019-01-16 11:14:14 [INFO    ] Finished processing BAM request
2019-01-16 11:14:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:14:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185798   8 58499 40454037 A  ERROR'
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 11:14:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 11:14:14 [DEBUG   ] spawn_process: at 2019-01-16 11:14:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 11:14:30 [DEBUG   ] Got command BAM from MCS: ref #1185799
2019-01-16 11:14:30 [INFO    ] Finished processing BAM request
2019-01-16 11:14:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:14:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185799   8 58499 40470025 A  ERROR'
2019-01-16 11:14:30 [DEBUG   ] Got command BAM from MCS: ref #1185800
2019-01-16 11:14:30 [INFO    ] Finished processing BAM request
2019-01-16 11:14:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:14:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185800   8 58499 40470029 A  ERROR'
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 11:14:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 11:14:30 [DEBUG   ] spawn_process: at 2019-01-16 11:14:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 11:14:31 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-01-16 11:14:46 [DEBUG   ] Got command BAM from MCS: ref #1185801
2019-01-16 11:14:46 [INFO    ] Finished processing BAM request
2019-01-16 11:14:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:14:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185801   8 58499 40486029 A  ERROR'
2019-01-16 11:14:46 [DEBUG   ] Got command BAM from MCS: ref #1185802
2019-01-16 11:14:46 [INFO    ] Finished processing BAM request
2019-01-16 11:14:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:14:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185802   8 58499 40486033 A  ERROR'
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 11:14:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 11:14:46 [DEBUG   ] spawn_process: at 2019-01-16 11:14:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 11:14:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:14:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:14:55 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 11:14:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 11:14:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 11:14:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:14:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:14:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:14:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:14:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:14:55 [DEBUG   ] Finished updating board flags in 1.193 seconds
2019-01-16 11:15:02 [DEBUG   ] Got command BAM from MCS: ref #1185808
2019-01-16 11:15:02 [INFO    ] Finished processing BAM request
2019-01-16 11:15:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:15:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185808   8 58499 40502029 A  ERROR'
2019-01-16 11:15:02 [DEBUG   ] Got command BAM from MCS: ref #1185807
2019-01-16 11:15:02 [INFO    ] Finished processing BAM request
2019-01-16 11:15:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:15:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185807   8 58499 40502033 A  ERROR'
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 11:15:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 11:15:02 [DEBUG   ] spawn_process: at 2019-01-16 11:15:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 11:15:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:15:18 [DEBUG   ] Got command BAM from MCS: ref #1185810
2019-01-16 11:15:18 [INFO    ] Finished processing BAM request
2019-01-16 11:15:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:15:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185810   8 58499 40518025 A  ERROR'
2019-01-16 11:15:18 [DEBUG   ] Got command BAM from MCS: ref #1185809
2019-01-16 11:15:18 [INFO    ] Finished processing BAM request
2019-01-16 11:15:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:15:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185809   8 58499 40518029 A  ERROR'
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 11:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 11:15:18 [DEBUG   ] spawn_process: at 2019-01-16 11:15:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 11:15:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:15:34 [DEBUG   ] Got command BAM from MCS: ref #1185811
2019-01-16 11:15:34 [INFO    ] Finished processing BAM request
2019-01-16 11:15:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:15:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185811   8 58499 40534029 A  ERROR'
2019-01-16 11:15:34 [DEBUG   ] Got command BAM from MCS: ref #1185812
2019-01-16 11:15:34 [INFO    ] Finished processing BAM request
2019-01-16 11:15:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:15:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185812   8 58499 40534033 A  ERROR'
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 11:15:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 11:15:34 [DEBUG   ] spawn_process: at 2019-01-16 11:15:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 11:15:50 [DEBUG   ] Got command BAM from MCS: ref #1185813
2019-01-16 11:15:50 [INFO    ] Finished processing BAM request
2019-01-16 11:15:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:15:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185813   8 58499 40550046 A  ERROR'
2019-01-16 11:15:50 [DEBUG   ] Got command BAM from MCS: ref #1185814
2019-01-16 11:15:50 [INFO    ] Finished processing BAM request
2019-01-16 11:15:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:15:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185814   8 58499 40550050 A  ERROR'
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 11:15:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 11:15:50 [DEBUG   ] spawn_process: at 2019-01-16 11:15:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 11:15:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:15:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 11:15:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2019-01-16 11:15:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:15:55 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 11:15:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:15:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:15:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:15:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:15:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:15:55 [DEBUG   ] Finished updating board flags in 0.999 seconds
2019-01-16 11:16:05 [DEBUG   ] Got command RPT from MCS: ref #1185817
2019-01-16 11:16:05 [DEBUG   ] summary = ERROR
2019-01-16 11:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185817  13 58499 40565309 A  ERRORERROR'
2019-01-16 11:16:05 [DEBUG   ] Got command RPT from MCS: ref #1185818
2019-01-16 11:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185818  77 58499 40565310 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:16:06 [DEBUG   ] Got command BAM from MCS: ref #1185815
2019-01-16 11:16:06 [INFO    ] Finished processing BAM request
2019-01-16 11:16:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185815   8 58499 40566025 A  ERROR'
2019-01-16 11:16:06 [DEBUG   ] Got command BAM from MCS: ref #1185816
2019-01-16 11:16:06 [INFO    ] Finished processing BAM request
2019-01-16 11:16:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185816   8 58499 40566029 A  ERROR'
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 11:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 11:16:06 [DEBUG   ] spawn_process: at 2019-01-16 11:16:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 11:16:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:16:22 [DEBUG   ] Got command BAM from MCS: ref #1185835
2019-01-16 11:16:22 [INFO    ] Finished processing BAM request
2019-01-16 11:16:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:16:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185835   8 58499 40582045 A  ERROR'
2019-01-16 11:16:22 [DEBUG   ] Got command BAM from MCS: ref #1185834
2019-01-16 11:16:22 [INFO    ] Finished processing BAM request
2019-01-16 11:16:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:16:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185834   8 58499 40582049 A  ERROR'
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 11:16:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 11:16:22 [DEBUG   ] spawn_process: at 2019-01-16 11:16:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 11:16:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:16:38 [DEBUG   ] Got command BAM from MCS: ref #1185838
2019-01-16 11:16:38 [INFO    ] Finished processing BAM request
2019-01-16 11:16:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:16:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185838   8 58499 40598029 A  ERROR'
2019-01-16 11:16:38 [DEBUG   ] Got command BAM from MCS: ref #1185839
2019-01-16 11:16:38 [INFO    ] Finished processing BAM request
2019-01-16 11:16:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:16:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185839   8 58499 40598033 A  ERROR'
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 11:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 11:16:38 [DEBUG   ] spawn_process: at 2019-01-16 11:16:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 11:16:42 [DEBUG   ] Got command RPT from MCS: ref #1185840
2019-01-16 11:16:42 [DEBUG   ] summary = ERROR
2019-01-16 11:16:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185840  13 58499 40602089 A  ERRORERROR'
2019-01-16 11:16:42 [DEBUG   ] Got command RPT from MCS: ref #1185841
2019-01-16 11:16:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:16:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185841  77 58499 40602293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:16:42 [DEBUG   ] Got command RPT from MCS: ref #1185842
2019-01-16 11:16:42 [DEBUG   ] summary = ERROR
2019-01-16 11:16:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185842  13 58499 40602486 A  ERRORERROR'
2019-01-16 11:16:42 [DEBUG   ] Got command RPT from MCS: ref #1185844
2019-01-16 11:16:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:16:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185844  77 58499 40602690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:16:42 [DEBUG   ] Got command RPT from MCS: ref #1185845
2019-01-16 11:16:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 11:16:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185845  12 58499 40602893 A  ERRORB£ff'
2019-01-16 11:16:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:16:54 [DEBUG   ] Got command BAM from MCS: ref #1185851
2019-01-16 11:16:54 [INFO    ] Finished processing BAM request
2019-01-16 11:16:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:16:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185851   8 58499 40614034 A  ERROR'
2019-01-16 11:16:54 [DEBUG   ] Got command BAM from MCS: ref #1185850
2019-01-16 11:16:54 [INFO    ] Finished processing BAM request
2019-01-16 11:16:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:16:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185850   8 58499 40614038 A  ERROR'
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 11:16:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 11:16:54 [DEBUG   ] spawn_process: at 2019-01-16 11:16:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 11:16:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:16:55 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 11:16:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-01-16 11:16:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:16:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:16:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:16:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:16:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:16:55 [DEBUG   ] Finished updating board flags in 1.262 seconds
2019-01-16 11:17:10 [DEBUG   ] Got command BAM from MCS: ref #1185852
2019-01-16 11:17:10 [INFO    ] Finished processing BAM request
2019-01-16 11:17:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:17:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185852   8 58499 40630026 A  ERROR'
2019-01-16 11:17:10 [DEBUG   ] Got command BAM from MCS: ref #1185853
2019-01-16 11:17:10 [INFO    ] Finished processing BAM request
2019-01-16 11:17:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:17:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185853   8 58499 40630030 A  ERROR'
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 11:17:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 11:17:10 [DEBUG   ] spawn_process: at 2019-01-16 11:17:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 11:17:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:17:26 [DEBUG   ] Got command BAM from MCS: ref #1185855
2019-01-16 11:17:26 [INFO    ] Finished processing BAM request
2019-01-16 11:17:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:17:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185855   8 58499 40646030 A  ERROR'
2019-01-16 11:17:26 [DEBUG   ] Got command BAM from MCS: ref #1185854
2019-01-16 11:17:26 [INFO    ] Finished processing BAM request
2019-01-16 11:17:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:17:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185854   8 58499 40646034 A  ERROR'
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 11:17:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 11:17:26 [DEBUG   ] spawn_process: at 2019-01-16 11:17:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 11:17:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:17:42 [DEBUG   ] Got command BAM from MCS: ref #1185856
2019-01-16 11:17:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:17:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185856   8 58499 40662033 A  ERROR'
2019-01-16 11:17:42 [DEBUG   ] Got command BAM from MCS: ref #1185857
2019-01-16 11:17:42 [INFO    ] Finished processing BAM request
2019-01-16 11:17:42 [INFO    ] Finished processing BAM request
2019-01-16 11:17:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:17:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185857   8 58499 40662037 A  ERROR'
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 11:17:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 11:17:42 [DEBUG   ] spawn_process: at 2019-01-16 11:17:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 11:17:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:17:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:17:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 11:17:55 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 11:17:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:17:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:17:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:17:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:17:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:17:55 [DEBUG   ] Finished updating board flags in 1.217 seconds
2019-01-16 11:17:58 [DEBUG   ] Got command BAM from MCS: ref #1185863
2019-01-16 11:17:58 [INFO    ] Finished processing BAM request
2019-01-16 11:17:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:17:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185863   8 58499 40678025 A  ERROR'
2019-01-16 11:17:58 [DEBUG   ] Got command BAM from MCS: ref #1185862
2019-01-16 11:17:58 [INFO    ] Finished processing BAM request
2019-01-16 11:17:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:17:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185862   8 58499 40678029 A  ERROR'
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 11:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 11:17:58 [DEBUG   ] spawn_process: at 2019-01-16 11:17:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 11:18:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:18:15 [DEBUG   ] Got command BAM from MCS: ref #1185864
2019-01-16 11:18:15 [INFO    ] Finished processing BAM request
2019-01-16 11:18:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:18:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185864   8 58499 40695029 A  ERROR'
2019-01-16 11:18:15 [DEBUG   ] Got command BAM from MCS: ref #1185865
2019-01-16 11:18:15 [INFO    ] Finished processing BAM request
2019-01-16 11:18:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:18:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185865   8 58499 40695033 A  ERROR'
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-01-16 11:18:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-01-16 11:18:15 [DEBUG   ] spawn_process: at 2019-01-16 11:18:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-01-16 11:18:32 [DEBUG   ] Got command BAM from MCS: ref #1185866
2019-01-16 11:18:32 [INFO    ] Finished processing BAM request
2019-01-16 11:18:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:18:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185866   8 58499 40712029 A  ERROR'
2019-01-16 11:18:32 [DEBUG   ] Got command BAM from MCS: ref #1185867
2019-01-16 11:18:32 [INFO    ] Finished processing BAM request
2019-01-16 11:18:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:18:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185867   8 58499 40712033 A  ERROR'
2019-01-16 11:18:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-01-16 11:18:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-01-16 11:18:32 [DEBUG   ] spawn_process: at 2019-01-16 11:18:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-01-16 11:18:49 [DEBUG   ] Got command BAM from MCS: ref #1185868
2019-01-16 11:18:49 [INFO    ] Finished processing BAM request
2019-01-16 11:18:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:18:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185868   8 58499 40729025 A  ERROR'
2019-01-16 11:18:49 [DEBUG   ] Got command BAM from MCS: ref #1185869
2019-01-16 11:18:49 [INFO    ] Finished processing BAM request
2019-01-16 11:18:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:18:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185869   8 58499 40729029 A  ERROR'
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 11:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 11:18:49 [DEBUG   ] spawn_process: at 2019-01-16 11:18:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 11:18:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:18:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-16 11:18:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:18:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 11:18:55 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-01-16 11:18:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:18:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:18:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:18:55 [WARNING ] (13, 1, 'bot')
2019-01-16 11:18:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:18:55 [DEBUG   ] Finished updating board flags in 1.174 seconds
2019-01-16 11:19:06 [DEBUG   ] Got command BAM from MCS: ref #1185871
2019-01-16 11:19:06 [INFO    ] Finished processing BAM request
2019-01-16 11:19:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185871   8 58499 40746025 A  ERROR'
2019-01-16 11:19:06 [DEBUG   ] Got command BAM from MCS: ref #1185870
2019-01-16 11:19:06 [INFO    ] Finished processing BAM request
2019-01-16 11:19:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185870   8 58499 40746029 A  ERROR'
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 11:19:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 11:19:06 [DEBUG   ] spawn_process: at 2019-01-16 11:19:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 11:19:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:19:23 [DEBUG   ] Got command BAM from MCS: ref #1185872
2019-01-16 11:19:23 [INFO    ] Finished processing BAM request
2019-01-16 11:19:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:19:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185872   8 58499 40763033 A  ERROR'
2019-01-16 11:19:23 [DEBUG   ] Got command BAM from MCS: ref #1185873
2019-01-16 11:19:23 [INFO    ] Finished processing BAM request
2019-01-16 11:19:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:19:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185873   8 58499 40763037 A  ERROR'
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-01-16 11:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-01-16 11:19:23 [DEBUG   ] spawn_process: at 2019-01-16 11:19:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-01-16 11:19:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:19:40 [DEBUG   ] Got command BAM from MCS: ref #1185875
2019-01-16 11:19:40 [INFO    ] Finished processing BAM request
2019-01-16 11:19:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:19:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185875   8 58499 40780033 A  ERROR'
2019-01-16 11:19:40 [DEBUG   ] Got command BAM from MCS: ref #1185874
2019-01-16 11:19:40 [INFO    ] Finished processing BAM request
2019-01-16 11:19:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:19:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185874   8 58499 40780037 A  ERROR'
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 11:19:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 11:19:40 [DEBUG   ] spawn_process: at 2019-01-16 11:19:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 11:19:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:19:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:19:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 11:19:56 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-01-16 11:19:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:19:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:19:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:19:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:19:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:19:56 [DEBUG   ] Finished updating board flags in 1.564 seconds
2019-01-16 11:19:57 [DEBUG   ] Got command BAM from MCS: ref #1185876
2019-01-16 11:19:57 [INFO    ] Finished processing BAM request
2019-01-16 11:19:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:19:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185876   8 58499 40797033 A  ERROR'
2019-01-16 11:19:57 [DEBUG   ] Got command BAM from MCS: ref #1185877
2019-01-16 11:19:57 [INFO    ] Finished processing BAM request
2019-01-16 11:19:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-01-16 11:19:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1185877   8 58499 40797037 A  ERROR'
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-01-16 11:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-01-16 11:19:57 [DEBUG   ] spawn_process: at 2019-01-16 11:19:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-01-16 11:20:09 [DEBUG   ] Got command STP from MCS: ref #1185878
2019-01-16 11:20:09 [INFO    ] Finished processing BAM request
2019-01-16 11:20:09 [INFO    ] Shutdown the adder chain on beam #3
2019-01-16 11:20:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP  1185878   8 58499 40809025 A  ERROR'
2019-01-16 11:20:09 [DEBUG   ] Got command STP from MCS: ref #1185879
2019-01-16 11:20:09 [INFO    ] Finished processing BAM request
2019-01-16 11:20:09 [INFO    ] Shutdown the adder chain on beam #4
2019-01-16 11:20:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP  1185879   8 58499 40809029 A  ERROR'
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-01-16 11:20:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-01-16 11:20:09 [DEBUG   ] spawn_process: at 2019-01-16 11:20:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-01-16 11:20:12 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-16 11:20:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 11:20:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 11:20:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:20:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:20:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:20:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:20:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:20:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:20:56 [DEBUG   ] Finished updating board flags in 1.404 seconds
2019-01-16 11:21:05 [DEBUG   ] Got command RPT from MCS: ref #1185884
2019-01-16 11:21:05 [DEBUG   ] summary = ERROR
2019-01-16 11:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185884  13 58499 40865305 A  ERRORERROR'
2019-01-16 11:21:05 [DEBUG   ] Got command RPT from MCS: ref #1185885
2019-01-16 11:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185885  77 58499 40865306 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:21:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 11:21:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 11:21:42 [DEBUG   ] Got command RPT from MCS: ref #1185901
2019-01-16 11:21:42 [DEBUG   ] summary = ERROR
2019-01-16 11:21:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185901  13 58499 40902173 A  ERRORERROR'
2019-01-16 11:21:42 [DEBUG   ] Got command RPT from MCS: ref #1185902
2019-01-16 11:21:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:21:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185902  77 58499 40902377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:21:42 [DEBUG   ] Got command RPT from MCS: ref #1185903
2019-01-16 11:21:42 [DEBUG   ] summary = ERROR
2019-01-16 11:21:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185903  13 58499 40902569 A  ERRORERROR'
2019-01-16 11:21:42 [DEBUG   ] Got command RPT from MCS: ref #1185904
2019-01-16 11:21:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:21:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185904  77 58499 40902773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:21:42 [DEBUG   ] Got command RPT from MCS: ref #1185905
2019-01-16 11:21:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 11:21:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185905  12 58499 40902977 A  ERRORB�ff'
2019-01-16 11:21:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 11:21:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:21:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:21:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:21:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:21:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:21:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:21:56 [DEBUG   ] Finished updating board flags in 1.398 seconds
2019-01-16 11:22:12 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-16 11:22:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:22:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:22:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:22:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:22:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:22:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:22:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:22:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:22:56 [DEBUG   ] Finished updating board flags in 1.217 seconds
2019-01-16 11:23:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:23:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:23:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:23:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 11:23:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:23:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 11:23:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:23:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:23:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:23:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:23:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:23:56 [DEBUG   ] Finished updating board flags in 1.226 seconds
2019-01-16 11:24:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:24:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:24:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:24:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 11:24:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:24:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 11:24:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:24:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:24:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:24:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:24:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:24:56 [DEBUG   ] Finished updating board flags in 1.169 seconds
2019-01-16 11:25:12 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-16 11:25:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 11:25:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 11:25:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:25:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 11:25:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-16 11:25:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 11:25:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:25:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:25:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:25:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:25:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:25:56 [DEBUG   ] Finished updating board flags in 1.000 seconds
2019-01-16 11:26:05 [DEBUG   ] Got command RPT from MCS: ref #1185910
2019-01-16 11:26:05 [DEBUG   ] summary = ERROR
2019-01-16 11:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185910  13 58499 41165305 A  ERRORERROR'
2019-01-16 11:26:05 [DEBUG   ] Got command RPT from MCS: ref #1185911
2019-01-16 11:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185911  77 58499 41165306 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:26:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 11:26:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 11:26:42 [DEBUG   ] Got command RPT from MCS: ref #1185929
2019-01-16 11:26:42 [DEBUG   ] summary = ERROR
2019-01-16 11:26:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185929  13 58499 41202245 A  ERRORERROR'
2019-01-16 11:26:42 [DEBUG   ] Got command RPT from MCS: ref #1185930
2019-01-16 11:26:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:26:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185930  77 58499 41202449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:26:42 [DEBUG   ] Got command RPT from MCS: ref #1185931
2019-01-16 11:26:42 [DEBUG   ] summary = ERROR
2019-01-16 11:26:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185931  13 58499 41202653 A  ERRORERROR'
2019-01-16 11:26:42 [DEBUG   ] Got command RPT from MCS: ref #1185933
2019-01-16 11:26:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:26:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185933  77 58499 41202857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:26:43 [DEBUG   ] Got command RPT from MCS: ref #1185934
2019-01-16 11:26:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 11:26:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185934  12 58499 41203049 A  ERRORB™™š'
2019-01-16 11:26:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 11:26:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:26:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:26:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:26:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:26:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:26:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:26:56 [DEBUG   ] Finished updating board flags in 1.006 seconds
2019-01-16 11:27:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 11:27:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 11:27:52 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-16 11:27:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:27:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 11:27:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-01-16 11:27:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:27:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:27:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:27:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:27:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:27:56 [DEBUG   ] Finished updating board flags in 1.017 seconds
2019-01-16 11:28:12 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 11:28:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 11:28:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 11:28:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:28:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:28:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:28:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:28:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:28:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:28:56 [DEBUG   ] Finished updating board flags in 1.456 seconds
2019-01-16 11:29:12 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 11:29:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 11:29:52 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-16 11:29:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:29:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:29:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:29:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:29:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:29:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:29:56 [DEBUG   ] Finished updating board flags in 1.419 seconds
2019-01-16 11:30:12 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 11:30:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 11:30:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 11:30:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:30:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:30:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:30:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:30:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:30:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:30:56 [DEBUG   ] Finished updating board flags in 1.367 seconds
2019-01-16 11:31:05 [DEBUG   ] Got command RPT from MCS: ref #1185947
2019-01-16 11:31:05 [DEBUG   ] summary = ERROR
2019-01-16 11:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185947  13 58499 41465309 A  ERRORERROR'
2019-01-16 11:31:05 [DEBUG   ] Got command RPT from MCS: ref #1185948
2019-01-16 11:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185948  77 58499 41465310 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:31:12 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2019-01-16 11:31:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:31:42 [DEBUG   ] Got command RPT from MCS: ref #1185964
2019-01-16 11:31:42 [DEBUG   ] summary = ERROR
2019-01-16 11:31:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185964  13 58499 41502330 A  ERRORERROR'
2019-01-16 11:31:42 [DEBUG   ] Got command RPT from MCS: ref #1185965
2019-01-16 11:31:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:31:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185965  77 58499 41502533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:31:42 [DEBUG   ] Got command RPT from MCS: ref #1185966
2019-01-16 11:31:42 [DEBUG   ] summary = ERROR
2019-01-16 11:31:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185966  13 58499 41502737 A  ERRORERROR'
2019-01-16 11:31:42 [DEBUG   ] Got command RPT from MCS: ref #1185967
2019-01-16 11:31:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:31:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185967  77 58499 41502941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:31:43 [DEBUG   ] Got command RPT from MCS: ref #1185968
2019-01-16 11:31:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 11:31:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185968  12 58499 41503134 A  ERRORB˜™š'
2019-01-16 11:31:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:31:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:31:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:31:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:31:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:31:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:31:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:31:56 [DEBUG   ] Finished updating board flags in 1.238 seconds
2019-01-16 11:32:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:32:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:32:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:32:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:32:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:32:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:32:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:32:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:32:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:32:57 [DEBUG   ] Finished updating board flags in 1.752 seconds
2019-01-16 11:33:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:33:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 11:33:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:33:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 11:33:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:33:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:33:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:33:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:33:56 [WARNING ] (13, 1, 'bot')
2019-01-16 11:33:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:33:56 [DEBUG   ] Finished updating board flags in 0.997 seconds
2019-01-16 11:34:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:34:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 11:34:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:34:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:34:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:34:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:34:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:34:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:34:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:34:57 [DEBUG   ] Finished updating board flags in 1.370 seconds
2019-01-16 11:35:13 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-16 11:35:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 11:35:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 11:35:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:35:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:35:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:35:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:35:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:35:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:35:57 [DEBUG   ] Finished updating board flags in 1.191 seconds
2019-01-16 11:36:05 [DEBUG   ] Got command RPT from MCS: ref #1185977
2019-01-16 11:36:05 [DEBUG   ] summary = ERROR
2019-01-16 11:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185977  13 58499 41765313 A  ERRORERROR'
2019-01-16 11:36:05 [DEBUG   ] Got command RPT from MCS: ref #1185978
2019-01-16 11:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185978  77 58499 41765314 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:36:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 11:36:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 11:36:42 [DEBUG   ] Got command RPT from MCS: ref #1185996
2019-01-16 11:36:42 [DEBUG   ] summary = ERROR
2019-01-16 11:36:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185996  13 58499 41802409 A  ERRORERROR'
2019-01-16 11:36:42 [DEBUG   ] Got command RPT from MCS: ref #1185997
2019-01-16 11:36:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:36:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185997  77 58499 41802613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:36:42 [DEBUG   ] Got command RPT from MCS: ref #1185998
2019-01-16 11:36:42 [DEBUG   ] summary = ERROR
2019-01-16 11:36:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1185998  13 58499 41802817 A  ERRORERROR'
2019-01-16 11:36:43 [DEBUG   ] Got command RPT from MCS: ref #1186000
2019-01-16 11:36:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186000  77 58499 41803009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:36:43 [DEBUG   ] Got command RPT from MCS: ref #1186001
2019-01-16 11:36:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 11:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186001  12 58499 41803213 A  ERRORB˜™š'
2019-01-16 11:36:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 11:36:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 11:36:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:36:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:36:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:36:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:36:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:36:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:36:57 [DEBUG   ] Finished updating board flags in 1.030 seconds
2019-01-16 11:37:13 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-01-16 11:37:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:37:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 11:37:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 11:37:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:37:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:37:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:37:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:37:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:37:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:37:58 [DEBUG   ] Finished updating board flags in 1.999 seconds
2019-01-16 11:38:13 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-16 11:38:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 11:38:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 11:38:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:38:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:38:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:38:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:38:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:38:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:38:57 [DEBUG   ] Finished updating board flags in 1.221 seconds
2019-01-16 11:39:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 11:39:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 11:39:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 11:39:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:39:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 11:39:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:39:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:39:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:39:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:39:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:39:58 [DEBUG   ] Finished updating board flags in 1.774 seconds
2019-01-16 11:40:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 11:40:33 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2019-01-16 11:40:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 11:40:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:40:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:40:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:40:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:40:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:40:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:40:57 [DEBUG   ] Finished updating board flags in 1.029 seconds
2019-01-16 11:41:05 [DEBUG   ] Got command RPT from MCS: ref #1186010
2019-01-16 11:41:05 [DEBUG   ] summary = ERROR
2019-01-16 11:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186010  13 58499 42065309 A  ERRORERROR'
2019-01-16 11:41:05 [DEBUG   ] Got command RPT from MCS: ref #1186011
2019-01-16 11:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186011  77 58499 42065310 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:41:13 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-16 11:41:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-16 11:41:42 [DEBUG   ] Got command RPT from MCS: ref #1186027
2019-01-16 11:41:42 [DEBUG   ] summary = ERROR
2019-01-16 11:41:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186027  13 58499 42102501 A  ERRORERROR'
2019-01-16 11:41:42 [DEBUG   ] Got command RPT from MCS: ref #1186028
2019-01-16 11:41:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:41:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186028  77 58499 42102693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:41:42 [DEBUG   ] Got command RPT from MCS: ref #1186029
2019-01-16 11:41:42 [DEBUG   ] summary = ERROR
2019-01-16 11:41:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186029  13 58499 42102897 A  ERRORERROR'
2019-01-16 11:41:43 [DEBUG   ] Got command RPT from MCS: ref #1186030
2019-01-16 11:41:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:41:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186030  77 58499 42103101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:41:43 [DEBUG   ] Got command RPT from MCS: ref #1186031
2019-01-16 11:41:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 11:41:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186031  12 58499 42103305 A  ERRORB™™š'
2019-01-16 11:41:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 11:41:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:41:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:41:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:41:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:41:57 [WARNING ] (13, 1, 'bot')
2019-01-16 11:41:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:41:57 [DEBUG   ] Finished updating board flags in 1.037 seconds
2019-01-16 11:42:00 [DEBUG   ] Got command TBN from MCS: ref #1186036
2019-01-16 11:42:00 [DEBUG   ] spawn_process: at 2019-01-16 11:42:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1547638922']
2019-01-16 11:42:01 [DEBUG   ] spawn_process: at 2019-01-16 11:42:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1547638922']
2019-01-16 11:42:01 [DEBUG   ] tbn = exited with status True, code 0x00
2019-01-16 11:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN  1186036   8 58499 42121001 A  ERROR'
2019-01-16 11:42:01 [DEBUG   ] spawn_process: at 2019-01-16 11:42:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1547638922']
2019-01-16 11:42:01 [DEBUG   ] spawn_process: at 2019-01-16 11:42:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1547638922']
2019-01-16 11:42:01 [DEBUG   ] spawn_process: at 2019-01-16 11:42:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1547638922']
2019-01-16 11:42:01 [DEBUG   ] spawn_process: at 2019-01-16 11:42:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1547638922']
2019-01-16 11:42:01 [DEBUG   ] spawn_process: at 2019-01-16 11:42:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1547638922']
2019-01-16 11:42:01 [DEBUG   ] spawn_process: at 2019-01-16 11:42:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1547638922']
2019-01-16 11:42:01 [DEBUG   ] spawn_process: at 2019-01-16 11:42:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1547638922']
2019-01-16 11:42:01 [DEBUG   ] spawn_process: at 2019-01-16 11:42:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1547638922']
2019-01-16 11:42:01 [DEBUG   ] spawn_process: at 2019-01-16 11:42:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1547638922']
2019-01-16 11:42:01 [DEBUG   ] spawn_process: at 2019-01-16 11:42:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1547638922']
2019-01-16 11:42:01 [DEBUG   ] spawn_process: at 2019-01-16 11:42:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1547638922']
2019-01-16 11:42:01 [DEBUG   ] spawn_process: at 2019-01-16 11:42:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1547638922']
2019-01-16 11:42:01 [DEBUG   ] spawn_process: at 2019-01-16 11:42:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1547638922']
2019-01-16 11:42:01 [DEBUG   ] spawn_process: at 2019-01-16 11:42:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1547638922']
2019-01-16 11:42:01 [DEBUG   ] spawn_process: at 2019-01-16 11:42:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1547638922']
2019-01-16 11:42:01 [DEBUG   ] spawn_process: at 2019-01-16 11:42:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1547638922']
2019-01-16 11:42:01 [DEBUG   ] spawn_process: at 2019-01-16 11:42:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1547638922']
2019-01-16 11:42:01 [DEBUG   ] spawn_process: at 2019-01-16 11:42:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1547638922']
2019-01-16 11:42:01 [DEBUG   ] spawn_process: at 2019-01-16 11:42:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1547638922']
2019-01-16 11:42:01 [DEBUG   ] spawn_process: at 2019-01-16 11:42:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1547638922']
2019-01-16 11:42:01 [DEBUG   ] spawn_process: at 2019-01-16 11:42:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1547638922']
2019-01-16 11:42:01 [DEBUG   ] spawn_process: at 2019-01-16 11:42:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1547638922']
2019-01-16 11:42:01 [DEBUG   ] spawn_process: at 2019-01-16 11:42:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1547638922']
2019-01-16 11:42:01 [DEBUG   ] spawn_process: at 2019-01-16 11:42:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1547638922']
2019-01-16 11:42:01 [INFO    ] Finished spawning TBN in 0.049 s
2019-01-16 11:42:13 [DEBUG   ] Finished updating ant stats in 0.470 seconds
2019-01-16 11:42:34 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-16 11:42:54 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-16 11:42:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:42:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:42:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:42:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:42:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:42:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:42:58 [DEBUG   ] Finished updating board flags in 1.761 seconds
2019-01-16 11:43:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 11:43:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:43:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:43:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:43:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:43:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:43:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:43:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:43:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:43:58 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-01-16 11:44:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 11:44:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 11:44:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:44:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:44:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:44:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:44:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:44:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:44:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:44:58 [DEBUG   ] Finished updating board flags in 1.574 seconds
2019-01-16 11:45:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:45:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 11:45:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 11:45:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 11:45:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:45:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:45:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:45:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:45:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:45:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:45:58 [DEBUG   ] Finished updating board flags in 1.477 seconds
2019-01-16 11:46:05 [DEBUG   ] Got command RPT from MCS: ref #1186041
2019-01-16 11:46:05 [DEBUG   ] summary = ERROR
2019-01-16 11:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186041  13 58499 42365313 A  ERRORERROR'
2019-01-16 11:46:05 [DEBUG   ] Got command RPT from MCS: ref #1186042
2019-01-16 11:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186042  77 58499 42365314 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:46:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:46:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 11:46:42 [DEBUG   ] Got command RPT from MCS: ref #1186060
2019-01-16 11:46:42 [DEBUG   ] summary = ERROR
2019-01-16 11:46:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186060  13 58499 42402577 A  ERRORERROR'
2019-01-16 11:46:42 [DEBUG   ] Got command RPT from MCS: ref #1186061
2019-01-16 11:46:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:46:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186061  77 58499 42402781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:46:42 [DEBUG   ] Got command RPT from MCS: ref #1186062
2019-01-16 11:46:42 [DEBUG   ] summary = ERROR
2019-01-16 11:46:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186062  13 58499 42402985 A  ERRORERROR'
2019-01-16 11:46:43 [DEBUG   ] Got command RPT from MCS: ref #1186064
2019-01-16 11:46:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:46:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186064  77 58499 42403177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:46:43 [DEBUG   ] Got command RPT from MCS: ref #1186065
2019-01-16 11:46:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 11:46:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186065  12 58499 42403381 A  ERRORB˜™š'
2019-01-16 11:46:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 11:46:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:46:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:46:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:46:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:46:58 [WARNING ] (13, 1, 'bot')
2019-01-16 11:46:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:46:58 [DEBUG   ] Finished updating board flags in 1.559 seconds
2019-01-16 11:47:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 11:47:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:47:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:47:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:47:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:47:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:47:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:47:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:47:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:47:59 [DEBUG   ] Finished updating board flags in 2.280 seconds
2019-01-16 11:48:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 11:48:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 11:48:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 11:48:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:48:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:48:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:48:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:48:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:48:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:48:59 [DEBUG   ] Finished updating board flags in 2.101 seconds
2019-01-16 11:49:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:49:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 11:49:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 11:49:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:49:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:49:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:49:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:49:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:49:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:49:59 [DEBUG   ] Finished updating board flags in 2.033 seconds
2019-01-16 11:50:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 11:50:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:50:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 11:50:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:50:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:50:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:50:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:50:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:50:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:50:59 [DEBUG   ] Finished updating board flags in 1.963 seconds
2019-01-16 11:51:05 [DEBUG   ] Got command RPT from MCS: ref #1186078
2019-01-16 11:51:05 [DEBUG   ] summary = ERROR
2019-01-16 11:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186078  13 58499 42665309 A  ERRORERROR'
2019-01-16 11:51:05 [DEBUG   ] Got command RPT from MCS: ref #1186079
2019-01-16 11:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186079  77 58499 42665310 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:51:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 11:51:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 11:51:42 [DEBUG   ] Got command RPT from MCS: ref #1186095
2019-01-16 11:51:42 [DEBUG   ] summary = ERROR
2019-01-16 11:51:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186095  13 58499 42702661 A  ERRORERROR'
2019-01-16 11:51:42 [DEBUG   ] Got command RPT from MCS: ref #1186096
2019-01-16 11:51:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:51:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186096  77 58499 42702853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:51:43 [DEBUG   ] Got command RPT from MCS: ref #1186097
2019-01-16 11:51:43 [DEBUG   ] summary = ERROR
2019-01-16 11:51:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186097  13 58499 42703057 A  ERRORERROR'
2019-01-16 11:51:43 [DEBUG   ] Got command RPT from MCS: ref #1186098
2019-01-16 11:51:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:51:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186098  77 58499 42703261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:51:43 [DEBUG   ] Got command RPT from MCS: ref #1186099
2019-01-16 11:51:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 11:51:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186099  12 58499 42703465 A  ERRORB™™š'
2019-01-16 11:51:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:51:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:51:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 11:51:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:51:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:51:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:51:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:51:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:51:59 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-16 11:52:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 11:52:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 11:52:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:52:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:52:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:52:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:52:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:52:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:52:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:52:59 [DEBUG   ] Finished updating board flags in 1.863 seconds
2019-01-16 11:53:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 11:53:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 11:53:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 11:53:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:53:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:53:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:53:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:53:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:53:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:53:59 [DEBUG   ] Finished updating board flags in 1.736 seconds
2019-01-16 11:54:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 11:54:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 11:54:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 11:54:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:54:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:54:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:54:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:54:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:54:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:54:59 [DEBUG   ] Finished updating board flags in 1.673 seconds
2019-01-16 11:55:14 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-01-16 11:55:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 11:55:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 11:55:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 11:55:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:55:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:55:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:55:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:55:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:55:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:55:59 [DEBUG   ] Finished updating board flags in 1.526 seconds
2019-01-16 11:56:05 [DEBUG   ] Got command RPT from MCS: ref #1186104
2019-01-16 11:56:05 [DEBUG   ] summary = ERROR
2019-01-16 11:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186104  13 58499 42965321 A  ERRORERROR'
2019-01-16 11:56:05 [DEBUG   ] Got command RPT from MCS: ref #1186105
2019-01-16 11:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186105  77 58499 42965322 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:56:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 11:56:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 11:56:42 [DEBUG   ] Got command RPT from MCS: ref #1186123
2019-01-16 11:56:42 [DEBUG   ] summary = ERROR
2019-01-16 11:56:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186123  13 58499 43002737 A  ERRORERROR'
2019-01-16 11:56:42 [DEBUG   ] Got command RPT from MCS: ref #1186124
2019-01-16 11:56:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:56:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186124  77 58499 43002941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:56:43 [DEBUG   ] Got command RPT from MCS: ref #1186125
2019-01-16 11:56:43 [DEBUG   ] summary = ERROR
2019-01-16 11:56:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186125  13 58499 43003145 A  ERRORERROR'
2019-01-16 11:56:43 [DEBUG   ] Got command RPT from MCS: ref #1186127
2019-01-16 11:56:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 11:56:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186127  77 58499 43003337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 11:56:43 [DEBUG   ] Got command RPT from MCS: ref #1186128
2019-01-16 11:56:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 11:56:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186128  12 58499 43003541 A  ERRORB˜™š'
2019-01-16 11:56:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 11:56:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:56:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:56:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:56:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:56:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:56:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:56:59 [DEBUG   ] Finished updating board flags in 1.414 seconds
2019-01-16 11:57:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 11:57:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 11:57:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 11:57:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-16 11:57:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:57:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 11:57:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 11:57:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:57:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:57:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:57:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:57:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:57:59 [DEBUG   ] Finished updating board flags in 1.488 seconds
2019-01-16 11:58:14 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-16 11:58:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 11:58:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 11:58:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:58:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:58:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:58:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:58:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:58:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:58:59 [DEBUG   ] Finished updating board flags in 1.490 seconds
2019-01-16 11:59:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 11:59:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:59:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 11:59:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 11:59:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 11:59:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:59:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:59:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:59:59 [WARNING ] (13, 1, 'bot')
2019-01-16 11:59:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 11:59:59 [DEBUG   ] Finished updating board flags in 1.492 seconds
2019-01-16 12:00:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-16 12:00:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 12:00:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 12:00:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:01:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:01:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:01:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:01:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:01:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:01:00 [DEBUG   ] Finished updating board flags in 2.178 seconds
2019-01-16 12:01:05 [DEBUG   ] Got command RPT from MCS: ref #1186141
2019-01-16 12:01:05 [DEBUG   ] summary = ERROR
2019-01-16 12:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186141  13 58499 43265317 A  ERRORERROR'
2019-01-16 12:01:05 [DEBUG   ] Got command RPT from MCS: ref #1186142
2019-01-16 12:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186142  77 58499 43265318 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:01:14 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2019-01-16 12:01:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 12:01:42 [DEBUG   ] Got command RPT from MCS: ref #1186158
2019-01-16 12:01:42 [DEBUG   ] summary = ERROR
2019-01-16 12:01:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186158  13 58499 43302821 A  ERRORERROR'
2019-01-16 12:01:43 [DEBUG   ] Got command RPT from MCS: ref #1186159
2019-01-16 12:01:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:01:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186159  77 58499 43303025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:01:43 [DEBUG   ] Got command RPT from MCS: ref #1186160
2019-01-16 12:01:43 [DEBUG   ] summary = ERROR
2019-01-16 12:01:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186160  13 58499 43303229 A  ERRORERROR'
2019-01-16 12:01:43 [DEBUG   ] Got command RPT from MCS: ref #1186161
2019-01-16 12:01:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:01:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186161  77 58499 43303421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:01:43 [DEBUG   ] Got command RPT from MCS: ref #1186162
2019-01-16 12:01:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 12:01:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186162  12 58499 43303625 A  ERRORB™™š'
2019-01-16 12:01:55 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-16 12:01:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:02:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:02:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:02:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:02:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:02:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:02:00 [DEBUG   ] Finished updating board flags in 1.957 seconds
2019-01-16 12:02:15 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-16 12:02:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 12:02:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-01-16 12:02:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:03:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:03:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:03:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:03:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:03:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:03:00 [DEBUG   ] Finished updating board flags in 1.807 seconds
2019-01-16 12:03:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 12:03:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 12:03:55 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-16 12:03:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:04:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:04:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:04:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:04:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:04:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:04:00 [DEBUG   ] Finished updating board flags in 1.828 seconds
2019-01-16 12:04:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 12:04:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 12:04:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 12:04:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:05:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:05:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:05:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:05:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:05:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:05:00 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-16 12:05:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 12:05:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 12:05:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 12:05:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:06:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2019-01-16 12:06:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:06:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:06:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:06:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:06:00 [WARNING ] (25, 5, 'bot')
2019-01-16 12:06:00 [WARNING ] (25, 5, 'bot')
2019-01-16 12:06:00 [WARNING ] (25, 5, 'bot')
2019-01-16 12:06:00 [WARNING ] (25, 5, 'bot')
2019-01-16 12:06:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:06:00 [DEBUG   ] Finished updating board flags in 1.759 seconds
2019-01-16 12:06:05 [DEBUG   ] Got command RPT from MCS: ref #1186171
2019-01-16 12:06:05 [DEBUG   ] summary = ERROR
2019-01-16 12:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186171  13 58499 43565321 A  ERRORERROR'
2019-01-16 12:06:05 [DEBUG   ] Got command RPT from MCS: ref #1186172
2019-01-16 12:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186172  77 58499 43565322 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:06:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 12:06:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 12:06:42 [DEBUG   ] Got command RPT from MCS: ref #1186190
2019-01-16 12:06:42 [DEBUG   ] summary = ERROR
2019-01-16 12:06:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186190  13 58499 43602897 A  ERRORERROR'
2019-01-16 12:06:43 [DEBUG   ] Got command RPT from MCS: ref #1186191
2019-01-16 12:06:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:06:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186191  77 58499 43603101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:06:43 [DEBUG   ] Got command RPT from MCS: ref #1186192
2019-01-16 12:06:43 [DEBUG   ] summary = ERROR
2019-01-16 12:06:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186192  13 58499 43603305 A  ERRORERROR'
2019-01-16 12:06:43 [DEBUG   ] Got command RPT from MCS: ref #1186194
2019-01-16 12:06:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:06:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186194  77 58499 43603509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:06:43 [DEBUG   ] Got command RPT from MCS: ref #1186195
2019-01-16 12:06:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 12:06:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186195  12 58499 43603701 A  ERRORB˜™š'
2019-01-16 12:06:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 12:06:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:07:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 12:07:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:07:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:07:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:07:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:07:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:07:00 [DEBUG   ] Finished updating board flags in 1.632 seconds
2019-01-16 12:07:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 12:07:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 12:07:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 12:07:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:08:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 12:08:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:08:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:08:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:08:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:08:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:08:00 [DEBUG   ] Finished updating board flags in 1.622 seconds
2019-01-16 12:08:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 12:08:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 12:08:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 12:08:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:09:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:09:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:09:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:09:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:09:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:09:00 [DEBUG   ] Finished updating board flags in 1.571 seconds
2019-01-16 12:09:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 12:09:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 12:09:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 12:09:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 12:10:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:10:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:10:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:10:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:10:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:10:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:10:00 [DEBUG   ] Finished updating board flags in 1.541 seconds
2019-01-16 12:10:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 12:10:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 12:10:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 12:11:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:11:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:11:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:11:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:11:00 [WARNING ] (13, 1, 'bot')
2019-01-16 12:11:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:11:00 [DEBUG   ] Finished updating board flags in 1.556 seconds
2019-01-16 12:11:05 [DEBUG   ] Got command RPT from MCS: ref #1186204
2019-01-16 12:11:05 [DEBUG   ] summary = ERROR
2019-01-16 12:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186204  13 58499 43865325 A  ERRORERROR'
2019-01-16 12:11:05 [DEBUG   ] Got command RPT from MCS: ref #1186205
2019-01-16 12:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186205  77 58499 43865326 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:11:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 12:11:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 12:11:42 [DEBUG   ] Got command RPT from MCS: ref #1186221
2019-01-16 12:11:42 [DEBUG   ] summary = ERROR
2019-01-16 12:11:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186221  13 58499 43902981 A  ERRORERROR'
2019-01-16 12:11:43 [DEBUG   ] Got command RPT from MCS: ref #1186222
2019-01-16 12:11:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:11:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186222  77 58499 43903185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:11:43 [DEBUG   ] Got command RPT from MCS: ref #1186223
2019-01-16 12:11:43 [DEBUG   ] summary = ERROR
2019-01-16 12:11:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186223  13 58499 43903389 A  ERRORERROR'
2019-01-16 12:11:43 [DEBUG   ] Got command RPT from MCS: ref #1186224
2019-01-16 12:11:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:11:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186224  77 58499 43903581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:11:43 [DEBUG   ] Got command RPT from MCS: ref #1186225
2019-01-16 12:11:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 12:11:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186225  12 58499 43903785 A  ERRORB™™š'
2019-01-16 12:11:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-16 12:12:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:12:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:12:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:12:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:12:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:12:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:12:01 [DEBUG   ] Finished updating board flags in 2.169 seconds
2019-01-16 12:12:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 12:12:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 12:12:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 12:13:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:13:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:13:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:13:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:13:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:13:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:13:01 [DEBUG   ] Finished updating board flags in 1.991 seconds
2019-01-16 12:13:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 12:13:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 12:13:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 12:14:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:14:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:14:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:14:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:14:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:14:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:14:01 [DEBUG   ] Finished updating board flags in 1.765 seconds
2019-01-16 12:14:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 12:14:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 12:14:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 12:15:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:15:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:15:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:15:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:15:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:15:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:15:01 [DEBUG   ] Finished updating board flags in 1.647 seconds
2019-01-16 12:15:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 12:15:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 12:15:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 12:16:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:16:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:16:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:16:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:16:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:16:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:16:01 [DEBUG   ] Finished updating board flags in 1.522 seconds
2019-01-16 12:16:05 [DEBUG   ] Got command RPT from MCS: ref #1186234
2019-01-16 12:16:05 [DEBUG   ] summary = ERROR
2019-01-16 12:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186234  13 58499 44165321 A  ERRORERROR'
2019-01-16 12:16:05 [DEBUG   ] Got command RPT from MCS: ref #1186235
2019-01-16 12:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186235  77 58499 44165322 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:16:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 12:16:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 12:16:43 [DEBUG   ] Got command RPT from MCS: ref #1186253
2019-01-16 12:16:43 [DEBUG   ] summary = ERROR
2019-01-16 12:16:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186253  13 58499 44203065 A  ERRORERROR'
2019-01-16 12:16:43 [DEBUG   ] Got command RPT from MCS: ref #1186254
2019-01-16 12:16:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:16:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186254  77 58499 44203269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:16:43 [DEBUG   ] Got command RPT from MCS: ref #1186255
2019-01-16 12:16:43 [DEBUG   ] summary = ERROR
2019-01-16 12:16:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186255  13 58499 44203461 A  ERRORERROR'
2019-01-16 12:16:43 [DEBUG   ] Got command RPT from MCS: ref #1186257
2019-01-16 12:16:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:16:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186257  77 58499 44203665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:16:43 [DEBUG   ] Got command RPT from MCS: ref #1186259
2019-01-16 12:16:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 12:16:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186259  12 58499 44203869 A  ERRORB™™š'
2019-01-16 12:16:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 12:17:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:17:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:17:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:17:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:17:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:17:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:17:01 [DEBUG   ] Finished updating board flags in 1.543 seconds
2019-01-16 12:17:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 12:17:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 12:17:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 12:18:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:18:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:18:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:18:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:18:01 [WARNING ] (13, 1, 'bot')
2019-01-16 12:18:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:18:01 [DEBUG   ] Finished updating board flags in 1.525 seconds
2019-01-16 12:18:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 12:18:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 12:18:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 12:19:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-01-16 12:19:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:19:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:19:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:19:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:19:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:19:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:19:02 [DEBUG   ] Finished updating board flags in 2.211 seconds
2019-01-16 12:19:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 12:19:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 12:19:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 12:20:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:20:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:20:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:20:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:20:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:20:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:20:02 [DEBUG   ] Finished updating board flags in 2.257 seconds
2019-01-16 12:20:15 [DEBUG   ] Finished updating ant stats in 0.793 seconds
2019-01-16 12:20:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 12:20:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 12:21:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:21:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:21:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:21:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:21:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:21:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:21:02 [DEBUG   ] Finished updating board flags in 2.079 seconds
2019-01-16 12:21:05 [DEBUG   ] Got command RPT from MCS: ref #1186271
2019-01-16 12:21:05 [DEBUG   ] summary = ERROR
2019-01-16 12:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186271  13 58499 44465318 A  ERRORERROR'
2019-01-16 12:21:05 [DEBUG   ] Got command RPT from MCS: ref #1186272
2019-01-16 12:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186272  77 58499 44465318 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:21:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 12:21:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 12:21:43 [DEBUG   ] Got command RPT from MCS: ref #1186288
2019-01-16 12:21:43 [DEBUG   ] summary = ERROR
2019-01-16 12:21:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186288  13 58499 44503141 A  ERRORERROR'
2019-01-16 12:21:43 [DEBUG   ] Got command RPT from MCS: ref #1186289
2019-01-16 12:21:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:21:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186289  77 58499 44503345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:21:43 [DEBUG   ] Got command RPT from MCS: ref #1186290
2019-01-16 12:21:43 [DEBUG   ] summary = ERROR
2019-01-16 12:21:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186290  13 58499 44503549 A  ERRORERROR'
2019-01-16 12:21:43 [DEBUG   ] Got command RPT from MCS: ref #1186291
2019-01-16 12:21:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:21:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186291  77 58499 44503741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:21:43 [DEBUG   ] Got command RPT from MCS: ref #1186292
2019-01-16 12:21:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 12:21:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186292  12 58499 44503945 A  ERRORB™™š'
2019-01-16 12:21:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 12:22:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:22:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 12:22:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:22:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:22:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:22:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:22:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:22:02 [DEBUG   ] Finished updating board flags in 2.004 seconds
2019-01-16 12:22:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 12:22:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 12:22:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 12:23:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:23:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:23:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:23:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:23:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:23:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:23:02 [DEBUG   ] Finished updating board flags in 2.016 seconds
2019-01-16 12:23:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 12:23:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 12:23:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 12:24:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:24:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:24:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:24:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:24:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:24:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:24:02 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-01-16 12:24:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 12:24:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 12:24:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 12:25:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:25:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:25:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:25:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:25:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:25:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:25:02 [DEBUG   ] Finished updating board flags in 1.917 seconds
2019-01-16 12:25:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 12:25:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 12:25:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 12:26:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:26:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:26:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:26:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:26:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:26:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:26:02 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-01-16 12:26:05 [DEBUG   ] Got command RPT from MCS: ref #1186297
2019-01-16 12:26:05 [DEBUG   ] summary = ERROR
2019-01-16 12:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186297  13 58499 44765322 A  ERRORERROR'
2019-01-16 12:26:05 [DEBUG   ] Got command RPT from MCS: ref #1186298
2019-01-16 12:26:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:26:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186298  77 58499 44765322 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:26:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 12:26:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-16 12:26:43 [DEBUG   ] Got command RPT from MCS: ref #1186316
2019-01-16 12:26:43 [DEBUG   ] summary = ERROR
2019-01-16 12:26:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186316  13 58499 44803222 A  ERRORERROR'
2019-01-16 12:26:43 [DEBUG   ] Got command RPT from MCS: ref #1186317
2019-01-16 12:26:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:26:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186317  77 58499 44803425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:26:43 [DEBUG   ] Got command RPT from MCS: ref #1186318
2019-01-16 12:26:43 [DEBUG   ] summary = ERROR
2019-01-16 12:26:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186318  13 58499 44803629 A  ERRORERROR'
2019-01-16 12:26:43 [DEBUG   ] Got command RPT from MCS: ref #1186320
2019-01-16 12:26:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:26:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186320  77 58499 44803833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:26:44 [DEBUG   ] Got command RPT from MCS: ref #1186322
2019-01-16 12:26:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 12:26:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186322  12 58499 44804025 A  ERRORB™™š'
2019-01-16 12:26:55 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-16 12:27:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 12:27:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:27:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:27:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:27:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:27:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:27:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:27:02 [DEBUG   ] Finished updating board flags in 1.668 seconds
2019-01-16 12:27:16 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2019-01-16 12:27:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 12:27:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 12:28:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:28:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:28:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:28:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:28:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:28:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:28:02 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-01-16 12:28:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 12:28:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 12:28:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 12:29:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:29:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:29:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:29:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:29:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:29:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:29:02 [DEBUG   ] Finished updating board flags in 1.599 seconds
2019-01-16 12:29:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 12:29:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 12:29:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 12:30:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:30:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:30:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:30:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:30:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:30:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:30:02 [DEBUG   ] Finished updating board flags in 1.444 seconds
2019-01-16 12:30:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-16 12:30:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 12:30:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 12:31:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:31:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:31:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:31:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:31:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:31:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:31:02 [DEBUG   ] Finished updating board flags in 1.361 seconds
2019-01-16 12:31:05 [DEBUG   ] Got command RPT from MCS: ref #1186334
2019-01-16 12:31:05 [DEBUG   ] summary = ERROR
2019-01-16 12:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186334  13 58499 45065325 A  ERRORERROR'
2019-01-16 12:31:05 [DEBUG   ] Got command RPT from MCS: ref #1186335
2019-01-16 12:31:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186335  77 58499 45065326 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:31:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 12:31:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 12:31:43 [DEBUG   ] Got command RPT from MCS: ref #1186351
2019-01-16 12:31:43 [DEBUG   ] summary = ERROR
2019-01-16 12:31:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186351  13 58499 45103309 A  ERRORERROR'
2019-01-16 12:31:43 [DEBUG   ] Got command RPT from MCS: ref #1186352
2019-01-16 12:31:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:31:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186352  77 58499 45103513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:31:43 [DEBUG   ] Got command RPT from MCS: ref #1186353
2019-01-16 12:31:43 [DEBUG   ] summary = ERROR
2019-01-16 12:31:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186353  13 58499 45103705 A  ERRORERROR'
2019-01-16 12:31:43 [DEBUG   ] Got command RPT from MCS: ref #1186354
2019-01-16 12:31:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:31:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186354  77 58499 45103909 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:31:44 [DEBUG   ] Got command RPT from MCS: ref #1186355
2019-01-16 12:31:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 12:31:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186355  12 58499 45104113 A  ERRORB™™š'
2019-01-16 12:31:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 12:32:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:32:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:32:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:32:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:32:02 [WARNING ] (13, 1, 'bot')
2019-01-16 12:32:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:32:02 [DEBUG   ] Finished updating board flags in 1.359 seconds
2019-01-16 12:32:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 12:32:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 12:32:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 12:33:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 12:33:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:33:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:33:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:33:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:33:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:33:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:33:03 [DEBUG   ] Finished updating board flags in 2.157 seconds
2019-01-16 12:33:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 12:33:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 12:33:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 12:34:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:34:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:34:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:34:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:34:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:34:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:34:03 [DEBUG   ] Finished updating board flags in 2.019 seconds
2019-01-16 12:34:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 12:34:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 12:34:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 12:35:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:35:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:35:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:35:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:35:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:35:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:35:03 [DEBUG   ] Finished updating board flags in 1.883 seconds
2019-01-16 12:35:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 12:35:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 12:35:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 12:36:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:36:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:36:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:36:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:36:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:36:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:36:03 [DEBUG   ] Finished updating board flags in 1.806 seconds
2019-01-16 12:36:05 [DEBUG   ] Got command RPT from MCS: ref #1186364
2019-01-16 12:36:05 [DEBUG   ] summary = ERROR
2019-01-16 12:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186364  13 58499 45365325 A  ERRORERROR'
2019-01-16 12:36:05 [DEBUG   ] Got command RPT from MCS: ref #1186365
2019-01-16 12:36:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186365  77 58499 45365326 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:36:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-16 12:36:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 12:36:43 [DEBUG   ] Got command RPT from MCS: ref #1186383
2019-01-16 12:36:43 [DEBUG   ] summary = ERROR
2019-01-16 12:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186383  13 58499 45403385 A  ERRORERROR'
2019-01-16 12:36:43 [DEBUG   ] Got command RPT from MCS: ref #1186384
2019-01-16 12:36:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186384  77 58499 45403589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:36:43 [DEBUG   ] Got command RPT from MCS: ref #1186385
2019-01-16 12:36:43 [DEBUG   ] summary = ERROR
2019-01-16 12:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186385  13 58499 45403793 A  ERRORERROR'
2019-01-16 12:36:43 [DEBUG   ] Got command RPT from MCS: ref #1186387
2019-01-16 12:36:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186387  77 58499 45403985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:36:44 [DEBUG   ] Got command RPT from MCS: ref #1186388
2019-01-16 12:36:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 12:36:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186388  12 58499 45404189 A  ERRORB™™š'
2019-01-16 12:36:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 12:37:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:37:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 12:37:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:37:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:37:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:37:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:37:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:37:03 [DEBUG   ] Finished updating board flags in 1.786 seconds
2019-01-16 12:37:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 12:37:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 12:37:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 12:38:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:38:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:38:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:38:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:38:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:38:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:38:03 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-01-16 12:38:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 12:38:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 12:38:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 12:39:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:39:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:39:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:39:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:39:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:39:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:39:03 [DEBUG   ] Finished updating board flags in 1.684 seconds
2019-01-16 12:39:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 12:39:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 12:39:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 12:40:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:40:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 12:40:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:40:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:40:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:40:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:40:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:40:03 [DEBUG   ] Finished updating board flags in 1.513 seconds
2019-01-16 12:40:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 12:40:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 12:40:56 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-16 12:41:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:41:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 12:41:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:41:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:41:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:41:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:41:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:41:03 [DEBUG   ] Finished updating board flags in 1.476 seconds
2019-01-16 12:41:05 [DEBUG   ] Got command RPT from MCS: ref #1186397
2019-01-16 12:41:05 [DEBUG   ] summary = ERROR
2019-01-16 12:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186397  13 58499 45665329 A  ERRORERROR'
2019-01-16 12:41:05 [DEBUG   ] Got command RPT from MCS: ref #1186398
2019-01-16 12:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186398  77 58499 45665330 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:41:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 12:41:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 12:41:43 [DEBUG   ] Got command RPT from MCS: ref #1186414
2019-01-16 12:41:43 [DEBUG   ] summary = ERROR
2019-01-16 12:41:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186414  13 58499 45703469 A  ERRORERROR'
2019-01-16 12:41:43 [DEBUG   ] Got command RPT from MCS: ref #1186415
2019-01-16 12:41:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:41:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186415  77 58499 45703673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:41:43 [DEBUG   ] Got command RPT from MCS: ref #1186416
2019-01-16 12:41:43 [DEBUG   ] summary = ERROR
2019-01-16 12:41:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186416  13 58499 45703865 A  ERRORERROR'
2019-01-16 12:41:44 [DEBUG   ] Got command RPT from MCS: ref #1186417
2019-01-16 12:41:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:41:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186417  77 58499 45704069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:41:44 [DEBUG   ] Got command RPT from MCS: ref #1186418
2019-01-16 12:41:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 12:41:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186418  12 58499 45704273 A  ERRORB˜™š'
2019-01-16 12:41:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 12:42:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 12:42:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:42:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:42:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:42:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:42:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:42:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:42:03 [DEBUG   ] Finished updating board flags in 1.478 seconds
2019-01-16 12:42:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 12:42:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 12:42:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 12:43:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:43:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:43:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:43:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:43:03 [WARNING ] (13, 1, 'bot')
2019-01-16 12:43:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:43:03 [DEBUG   ] Finished updating board flags in 1.507 seconds
2019-01-16 12:43:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 12:43:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 12:43:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-01-16 12:44:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 12:44:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:44:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:44:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:44:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:44:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:44:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:44:04 [DEBUG   ] Finished updating board flags in 2.204 seconds
2019-01-16 12:44:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-16 12:44:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 12:44:57 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-16 12:45:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:45:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:45:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:45:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:45:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:45:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:45:04 [DEBUG   ] Finished updating board flags in 2.138 seconds
2019-01-16 12:45:17 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-16 12:45:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 12:45:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 12:46:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:46:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:46:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:46:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:46:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:46:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:46:04 [DEBUG   ] Finished updating board flags in 2.001 seconds
2019-01-16 12:46:05 [DEBUG   ] Got command RPT from MCS: ref #1186427
2019-01-16 12:46:05 [DEBUG   ] summary = ERROR
2019-01-16 12:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186427  13 58499 45965325 A  ERRORERROR'
2019-01-16 12:46:05 [DEBUG   ] Got command RPT from MCS: ref #1186428
2019-01-16 12:46:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186428  77 58499 45965326 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:46:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 12:46:37 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-16 12:46:43 [DEBUG   ] Got command RPT from MCS: ref #1186446
2019-01-16 12:46:43 [DEBUG   ] summary = ERROR
2019-01-16 12:46:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186446  13 58499 46003549 A  ERRORERROR'
2019-01-16 12:46:43 [DEBUG   ] Got command RPT from MCS: ref #1186447
2019-01-16 12:46:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:46:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186447  77 58499 46003753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:46:43 [DEBUG   ] Got command RPT from MCS: ref #1186448
2019-01-16 12:46:43 [DEBUG   ] summary = ERROR
2019-01-16 12:46:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186448  13 58499 46003945 A  ERRORERROR'
2019-01-16 12:46:44 [DEBUG   ] Got command RPT from MCS: ref #1186450
2019-01-16 12:46:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:46:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186450  77 58499 46004149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:46:44 [DEBUG   ] Got command RPT from MCS: ref #1186451
2019-01-16 12:46:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 12:46:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186451  12 58499 46004353 A  ERRORB˜™š'
2019-01-16 12:46:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 12:47:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-01-16 12:47:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:47:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:47:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:47:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:47:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:47:04 [DEBUG   ] Finished updating board flags in 2.008 seconds
2019-01-16 12:47:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-16 12:47:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 12:47:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-01-16 12:48:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 12:48:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:48:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:48:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:48:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:48:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:48:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:48:04 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-01-16 12:48:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 12:48:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-16 12:48:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 12:49:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:49:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 12:49:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:49:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:49:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:49:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:49:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:49:04 [DEBUG   ] Finished updating board flags in 1.814 seconds
2019-01-16 12:49:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 12:49:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 12:49:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-16 12:50:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 12:50:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:50:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:50:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:50:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:50:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:50:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:50:04 [DEBUG   ] Finished updating board flags in 1.864 seconds
2019-01-16 12:50:18 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-16 12:50:38 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-01-16 12:50:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 12:51:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:51:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 12:51:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:51:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:51:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:51:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:51:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:51:04 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-01-16 12:51:05 [DEBUG   ] Got command RPT from MCS: ref #1186464
2019-01-16 12:51:05 [DEBUG   ] summary = ERROR
2019-01-16 12:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186464  13 58499 46265329 A  ERRORERROR'
2019-01-16 12:51:05 [DEBUG   ] Got command RPT from MCS: ref #1186465
2019-01-16 12:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186465  77 58499 46265330 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:51:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 12:51:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 12:51:43 [DEBUG   ] Got command RPT from MCS: ref #1186481
2019-01-16 12:51:43 [DEBUG   ] summary = ERROR
2019-01-16 12:51:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186481  13 58499 46303633 A  ERRORERROR'
2019-01-16 12:51:43 [DEBUG   ] Got command RPT from MCS: ref #1186482
2019-01-16 12:51:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:51:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186482  77 58499 46303825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:51:44 [DEBUG   ] Got command RPT from MCS: ref #1186483
2019-01-16 12:51:44 [DEBUG   ] summary = ERROR
2019-01-16 12:51:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186483  13 58499 46304029 A  ERRORERROR'
2019-01-16 12:51:44 [DEBUG   ] Got command RPT from MCS: ref #1186484
2019-01-16 12:51:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:51:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186484  77 58499 46304233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:51:44 [DEBUG   ] Got command RPT from MCS: ref #1186485
2019-01-16 12:51:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 12:51:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186485  12 58499 46304437 A  ERRORB˜™š'
2019-01-16 12:51:58 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-16 12:52:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:52:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:52:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:52:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:52:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:52:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:52:04 [DEBUG   ] Finished updating board flags in 1.719 seconds
2019-01-16 12:52:18 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2019-01-16 12:52:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 12:52:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 12:53:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:53:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:53:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:53:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:53:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:53:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:53:04 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-01-16 12:53:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-16 12:53:38 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-16 12:53:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 12:54:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:54:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 12:54:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:54:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:54:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:54:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:54:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:54:04 [DEBUG   ] Finished updating board flags in 1.589 seconds
2019-01-16 12:54:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 12:54:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 12:54:58 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-16 12:55:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:55:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:55:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:55:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:55:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:55:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:55:04 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-01-16 12:55:19 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-01-16 12:55:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-01-16 12:55:58 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-01-16 12:56:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 12:56:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:56:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:56:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:56:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:56:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:56:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:56:04 [DEBUG   ] Finished updating board flags in 1.387 seconds
2019-01-16 12:56:05 [DEBUG   ] Got command RPT from MCS: ref #1186490
2019-01-16 12:56:05 [DEBUG   ] summary = ERROR
2019-01-16 12:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186490  13 58499 46565325 A  ERRORERROR'
2019-01-16 12:56:05 [DEBUG   ] Got command RPT from MCS: ref #1186491
2019-01-16 12:56:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186491  77 58499 46565326 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:56:18 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-01-16 12:56:39 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-16 12:56:43 [DEBUG   ] Got command RPT from MCS: ref #1186509
2019-01-16 12:56:43 [DEBUG   ] summary = ERROR
2019-01-16 12:56:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186509  13 58499 46603713 A  ERRORERROR'
2019-01-16 12:56:43 [DEBUG   ] Got command RPT from MCS: ref #1186510
2019-01-16 12:56:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:56:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186510  77 58499 46603905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:56:44 [DEBUG   ] Got command RPT from MCS: ref #1186511
2019-01-16 12:56:44 [DEBUG   ] summary = ERROR
2019-01-16 12:56:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186511  13 58499 46604109 A  ERRORERROR'
2019-01-16 12:56:44 [DEBUG   ] Got command RPT from MCS: ref #1186513
2019-01-16 12:56:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 12:56:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186513  77 58499 46604313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 12:56:44 [DEBUG   ] Got command RPT from MCS: ref #1186515
2019-01-16 12:56:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 12:56:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186515  12 58499 46604505 A  ERRORB˜™š'
2019-01-16 12:56:58 [DEBUG   ] Finished updating ant stats in 0.408 seconds
2019-01-16 12:57:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:57:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:57:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:57:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:57:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:57:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:57:04 [DEBUG   ] Finished updating board flags in 1.405 seconds
2019-01-16 12:57:19 [DEBUG   ] Finished updating ant stats in 1.387 seconds
2019-01-16 12:57:39 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-01-16 12:57:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 12:58:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:58:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:58:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:58:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:58:04 [WARNING ] (13, 1, 'bot')
2019-01-16 12:58:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:58:04 [DEBUG   ] Finished updating board flags in 1.322 seconds
2019-01-16 12:58:19 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-16 12:58:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 12:58:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 12:59:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 12:59:05 [WARNING ] (13, 1, 'bot')
2019-01-16 12:59:05 [WARNING ] (13, 1, 'bot')
2019-01-16 12:59:05 [WARNING ] (13, 1, 'bot')
2019-01-16 12:59:05 [WARNING ] (13, 1, 'bot')
2019-01-16 12:59:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 12:59:05 [DEBUG   ] Finished updating board flags in 2.091 seconds
2019-01-16 12:59:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 12:59:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-01-16 12:59:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-01-16 13:00:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 13:00:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 13:00:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:00:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:00:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:00:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:00:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 13:00:05 [DEBUG   ] Finished updating board flags in 2.004 seconds
2019-01-16 13:00:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 13:00:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 13:00:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-16 13:01:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 13:01:05 [DEBUG   ] Got command RPT from MCS: ref #1186527
2019-01-16 13:01:05 [DEBUG   ] summary = ERROR
2019-01-16 13:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186527  13 58499 46865330 A  ERRORERROR'
2019-01-16 13:01:05 [DEBUG   ] Got command RPT from MCS: ref #1186528
2019-01-16 13:01:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 13:01:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186528  77 58499 46865330 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 13:01:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:01:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:01:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:01:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:01:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 13:01:05 [DEBUG   ] Finished updating board flags in 2.066 seconds
2019-01-16 13:01:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 13:01:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 13:01:43 [DEBUG   ] Got command RPT from MCS: ref #1186544
2019-01-16 13:01:43 [DEBUG   ] summary = ERROR
2019-01-16 13:01:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186544  13 58499 46903793 A  ERRORERROR'
2019-01-16 13:01:43 [DEBUG   ] Got command RPT from MCS: ref #1186545
2019-01-16 13:01:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 13:01:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186545  77 58499 46903986 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 13:01:44 [DEBUG   ] Got command RPT from MCS: ref #1186546
2019-01-16 13:01:44 [DEBUG   ] summary = ERROR
2019-01-16 13:01:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186546  13 58499 46904189 A  ERRORERROR'
2019-01-16 13:01:44 [DEBUG   ] Got command RPT from MCS: ref #1186547
2019-01-16 13:01:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 13:01:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186547  77 58499 46904393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 13:01:44 [DEBUG   ] Got command RPT from MCS: ref #1186548
2019-01-16 13:01:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 13:01:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186548  12 58499 46904586 A  ERRORB™™š'
2019-01-16 13:01:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 13:02:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 13:02:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 13:02:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:02:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:02:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:02:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:02:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 13:02:05 [DEBUG   ] Finished updating board flags in 1.933 seconds
2019-01-16 13:02:19 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-16 13:02:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 13:02:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 13:03:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 13:03:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 13:03:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:03:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:03:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:03:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:03:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 13:03:05 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-01-16 13:03:20 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-16 13:03:40 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-16 13:04:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-01-16 13:04:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 13:04:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:04:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:04:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:04:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:04:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 13:04:05 [DEBUG   ] Finished updating board flags in 1.795 seconds
2019-01-16 13:04:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 13:04:40 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-16 13:05:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 13:05:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 13:05:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:05:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:05:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:05:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:05:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 13:05:05 [DEBUG   ] Finished updating board flags in 1.606 seconds
2019-01-16 13:05:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 13:05:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 13:06:00 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-16 13:06:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 13:06:05 [DEBUG   ] Got command RPT from MCS: ref #1186557
2019-01-16 13:06:05 [DEBUG   ] summary = ERROR
2019-01-16 13:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186557  13 58499 47165329 A  ERRORERROR'
2019-01-16 13:06:05 [DEBUG   ] Got command RPT from MCS: ref #1186558
2019-01-16 13:06:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 13:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186558  77 58499 47165330 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 13:06:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:06:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:06:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:06:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:06:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 13:06:05 [DEBUG   ] Finished updating board flags in 1.595 seconds
2019-01-16 13:06:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 13:06:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 13:06:43 [DEBUG   ] Got command RPT from MCS: ref #1186576
2019-01-16 13:06:43 [DEBUG   ] summary = ERROR
2019-01-16 13:06:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186576  13 58499 47203865 A  ERRORERROR'
2019-01-16 13:06:44 [DEBUG   ] Got command RPT from MCS: ref #1186577
2019-01-16 13:06:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 13:06:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186577  77 58499 47204069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 13:06:44 [DEBUG   ] Got command RPT from MCS: ref #1186578
2019-01-16 13:06:44 [DEBUG   ] summary = ERROR
2019-01-16 13:06:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186578  13 58499 47204273 A  ERRORERROR'
2019-01-16 13:06:44 [DEBUG   ] Got command RPT from MCS: ref #1186579
2019-01-16 13:06:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 13:06:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186579  77 58499 47204465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 13:06:44 [DEBUG   ] Got command RPT from MCS: ref #1186581
2019-01-16 13:06:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 13:06:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186581  12 58499 47204669 A  ERRORB˜™š'
2019-01-16 13:07:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-01-16 13:07:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-01-16 13:07:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 13:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-01-16 13:07:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:07:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:07:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:07:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:07:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 13:07:05 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-01-16 13:07:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-01-16 13:07:41 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-16 13:08:01 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-01-16 13:08:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 13:08:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:08:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:08:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:08:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:08:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 13:08:05 [DEBUG   ] Finished updating board flags in 1.383 seconds
2019-01-16 13:08:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-16 13:08:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 13:09:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-01-16 13:09:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 13:09:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 13:09:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:09:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:09:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:09:05 [WARNING ] (13, 1, 'bot')
2019-01-16 13:09:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 13:09:05 [DEBUG   ] Finished updating board flags in 1.359 seconds
2019-01-16 13:09:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-16 13:09:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 13:10:01 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-16 13:10:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 13:10:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:10:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:10:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:10:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:10:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 13:10:06 [DEBUG   ] Finished updating board flags in 2.069 seconds
2019-01-16 13:10:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 13:10:42 [DEBUG   ] Finished updating ant stats in 1.603 seconds
2019-01-16 13:11:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 13:11:05 [DEBUG   ] Got command RPT from MCS: ref #1186590
2019-01-16 13:11:05 [DEBUG   ] summary = ERROR
2019-01-16 13:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186590  13 58499 47465329 A  ERRORERROR'
2019-01-16 13:11:05 [DEBUG   ] Got command RPT from MCS: ref #1186591
2019-01-16 13:11:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 13:11:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186591  77 58499 47465330 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 13:11:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 13:11:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:11:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:11:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:11:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:11:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 13:11:06 [DEBUG   ] Finished updating board flags in 1.983 seconds
2019-01-16 13:11:21 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-16 13:11:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-01-16 13:11:43 [DEBUG   ] Got command RPT from MCS: ref #1186607
2019-01-16 13:11:43 [DEBUG   ] summary = ERROR
2019-01-16 13:11:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186607  13 58499 47503941 A  ERRORERROR'
2019-01-16 13:11:44 [DEBUG   ] Got command RPT from MCS: ref #1186608
2019-01-16 13:11:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 13:11:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186608  77 58499 47504145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 13:11:44 [DEBUG   ] Got command RPT from MCS: ref #1186609
2019-01-16 13:11:44 [DEBUG   ] summary = ERROR
2019-01-16 13:11:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186609  13 58499 47504349 A  ERRORERROR'
2019-01-16 13:11:44 [DEBUG   ] Got command RPT from MCS: ref #1186610
2019-01-16 13:11:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 13:11:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186610  77 58499 47504553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 13:11:44 [DEBUG   ] Got command RPT from MCS: ref #1186611
2019-01-16 13:11:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 13:11:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186611  12 58499 47504745 A  ERRORB™™š'
2019-01-16 13:12:02 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-01-16 13:12:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 13:12:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:12:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:12:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:12:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:12:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 13:12:06 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-01-16 13:12:22 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-16 13:12:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 13:13:02 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-01-16 13:13:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 13:13:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 13:13:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:13:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:13:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:13:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:13:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 13:13:06 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-01-16 13:13:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-16 13:13:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-01-16 13:14:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 13:14:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-01-16 13:14:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 13:14:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:14:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:14:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:14:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:14:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 13:14:06 [DEBUG   ] Finished updating board flags in 1.791 seconds
2019-01-16 13:14:22 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-01-16 13:14:42 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-01-16 13:15:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 13:15:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 13:15:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:15:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:15:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:15:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:15:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 13:15:06 [DEBUG   ] Finished updating board flags in 1.611 seconds
2019-01-16 13:15:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-01-16 13:15:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 13:16:02 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-01-16 13:16:05 [DEBUG   ] Got command RPT from MCS: ref #1186620
2019-01-16 13:16:05 [DEBUG   ] summary = ERROR
2019-01-16 13:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186620  13 58499 47765341 A  ERRORERROR'
2019-01-16 13:16:05 [DEBUG   ] Got command RPT from MCS: ref #1186621
2019-01-16 13:16:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 13:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186621  77 58499 47765342 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 13:16:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 13:16:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:16:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:16:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:16:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:16:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 13:16:06 [DEBUG   ] Finished updating board flags in 1.587 seconds
2019-01-16 13:16:23 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-01-16 13:16:43 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-01-16 13:16:44 [DEBUG   ] Got command RPT from MCS: ref #1186639
2019-01-16 13:16:44 [DEBUG   ] summary = ERROR
2019-01-16 13:16:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186639  13 58499 47804025 A  ERRORERROR'
2019-01-16 13:16:44 [DEBUG   ] Got command RPT from MCS: ref #1186640
2019-01-16 13:16:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 13:16:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186640  77 58499 47804229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 13:16:44 [DEBUG   ] Got command RPT from MCS: ref #1186641
2019-01-16 13:16:44 [DEBUG   ] summary = ERROR
2019-01-16 13:16:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186641  13 58499 47804433 A  ERRORERROR'
2019-01-16 13:16:44 [DEBUG   ] Got command RPT from MCS: ref #1186643
2019-01-16 13:16:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 13:16:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186643  77 58499 47804625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 13:16:44 [DEBUG   ] Got command RPT from MCS: ref #1186644
2019-01-16 13:16:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 13:16:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186644  12 58499 47804829 A  ERRORB˜™š'
2019-01-16 13:17:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 13:17:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 13:17:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:17:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:17:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:17:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:17:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 13:17:06 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-01-16 13:17:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-01-16 13:17:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-01-16 13:18:03 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-01-16 13:18:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 13:18:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-01-16 13:18:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:18:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:18:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:18:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:18:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 13:18:06 [DEBUG   ] Finished updating board flags in 1.421 seconds
2019-01-16 13:18:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-01-16 13:18:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-01-16 13:19:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-01-16 13:19:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 13:19:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:19:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:19:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:19:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:19:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 13:19:06 [DEBUG   ] Finished updating board flags in 1.371 seconds
2019-01-16 13:19:23 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-16 13:19:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 13:20:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 13:20:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 13:20:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 13:20:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:20:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:20:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:20:06 [WARNING ] (13, 1, 'bot')
2019-01-16 13:20:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 13:20:06 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-01-16 13:20:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-01-16 13:20:43 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-01-16 13:21:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 13:21:05 [DEBUG   ] Got command RPT from MCS: ref #1186657
2019-01-16 13:21:05 [DEBUG   ] summary = ERROR
2019-01-16 13:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186657  13 58499 48065333 A  ERRORERROR'
2019-01-16 13:21:05 [DEBUG   ] Got command RPT from MCS: ref #1186658
2019-01-16 13:21:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 13:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186658  77 58499 48065334 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 13:21:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 13:21:07 [WARNING ] (13, 1, 'bot')
2019-01-16 13:21:07 [WARNING ] (13, 1, 'bot')
2019-01-16 13:21:07 [WARNING ] (13, 1, 'bot')
2019-01-16 13:21:07 [WARNING ] (13, 1, 'bot')
2019-01-16 13:21:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 13:21:07 [DEBUG   ] Finished updating board flags in 2.032 seconds
2019-01-16 13:21:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-01-16 13:21:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-01-16 13:21:44 [DEBUG   ] Got command RPT from MCS: ref #1186674
2019-01-16 13:21:44 [DEBUG   ] summary = ERROR
2019-01-16 13:21:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186674  13 58499 48104105 A  ERRORERROR'
2019-01-16 13:21:44 [DEBUG   ] Got command RPT from MCS: ref #1186675
2019-01-16 13:21:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 13:21:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186675  77 58499 48104309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 13:21:44 [DEBUG   ] Got command RPT from MCS: ref #1186676
2019-01-16 13:21:44 [DEBUG   ] summary = ERROR
2019-01-16 13:21:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186676  13 58499 48104513 A  ERRORERROR'
2019-01-16 13:21:44 [DEBUG   ] Got command RPT from MCS: ref #1186677
2019-01-16 13:21:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-01-16 13:21:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186677  77 58499 48104705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-01-16 13:21:44 [DEBUG   ] Got command RPT from MCS: ref #1186678
2019-01-16 13:21:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-01-16 13:21:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1186678  12 58499 48104909 A  ERRORB™™š'
2019-01-16 13:22:03 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-01-16 13:22:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 13:22:07 [WARNING ] (13, 1, 'bot')
2019-01-16 13:22:07 [WARNING ] (13, 1, 'bot')
2019-01-16 13:22:07 [WARNING ] (13, 1, 'bot')
2019-01-16 13:22:07 [WARNING ] (13, 1, 'bot')
2019-01-16 13:22:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 13:22:07 [DEBUG   ] Finished updating board flags in 2.059 seconds
2019-01-16 13:22:24 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-01-16 13:22:44 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-01-16 13:23:04 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-01-16 13:23:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 13:23:07 [WARNING ] (13, 1, 'bot')
2019-01-16 13:23:07 [WARNING ] (13, 1, 'bot')
2019-01-16 13:23:07 [WARNING ] (13, 1, 'bot')
2019-01-16 13:23:07 [WARNING ] (13, 1, 'bot')
2019-01-16 13:23:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 13:23:07 [DEBUG   ] Finished updating board flags in 1.988 seconds
2019-01-16 13:23:24 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-01-16 13:23:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-01-16 13:24:04 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-01-16 13:24:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-01-16 13:24:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-01-16 13:24:07 [WARNING ] (13, 1, 'bot')
2019-01-16 13:24:07 [WARNING ] (13, 1, 'bot')
2019-01-16 13:24:07 [WARNING ] (13, 1, 'bot')
2019-01-16 13:24:07 [WARNING ] (13, 1, 'bot')
2019-01-16 13:24:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-01-16 13:24:07 [DEBUG   ] Finished updating board flags in 1.750 seconds
2019-01-16 13:24:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-01-16 13:24:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
